Oct 23 15:17:28 user nova-compute[74421]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74421) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 15:17:28 user nova-compute[74421]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74421) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 15:17:28 user nova-compute[74421]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74421) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 15:17:28 user nova-compute[74421]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 23 15:17:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:17:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:17:28 user nova-compute[74421]: INFO nova.virt.driver [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 23 15:17:29 user nova-compute[74421]: INFO nova.compute.provider_config [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Acquiring lock "singleton_lock" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Acquired lock "singleton_lock" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Releasing lock "singleton_lock" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Full set of CONF: {{(pid=74421) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ******************************************************************************** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Configuration options gathered from: {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ================================================================================ {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] allow_resize_to_same_host      = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] arq_binding_timeout            = 300 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] backdoor_port                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] backdoor_socket                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] block_device_allocate_retries  = 300 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] block_device_allocate_retries_interval = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cert                           = self.pem {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute_monitors               = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] config_dir                     = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] config_drive_format            = iso9660 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] config_source                  = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] console_host                   = user {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] control_exchange               = nova {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cpu_allocation_ratio           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] daemon                         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] debug                          = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] default_access_ip_network_name = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] default_availability_zone      = nova {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] default_ephemeral_format       = ext4 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] default_green_pool_size        = 1000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] default_schedule_zone          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] disk_allocation_ratio          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] enable_new_services            = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] enabled_ssl_apis               = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] flat_injected                  = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] force_config_drive             = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] force_raw_images               = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] graceful_shutdown_timeout      = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] heal_instance_info_cache_interval = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] host                           = user {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_build_timeout         = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_delete_interval       = 300 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_name_template         = instance-%08x {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_usage_audit           = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_usage_audit_period    = month {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] internal_service_availability_zone = internal {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] key                            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] live_migration_retry_count     = 30 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_config_append              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_dir                        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_file                       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_options                    = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_rotate_interval            = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_rotate_interval_type       = days {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] log_rotation_type              = none {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] long_rpc_timeout               = 1800 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] max_concurrent_builds          = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] max_concurrent_live_migrations = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] max_concurrent_snapshots       = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] max_local_block_devices        = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] max_logfile_count              = 30 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] max_logfile_size_mb            = 200 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] maximum_instance_delete_attempts = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metadata_listen                = 0.0.0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metadata_listen_port           = 8775 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metadata_workers               = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] migrate_max_retries            = -1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] mkisofs_cmd                    = genisoimage {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] my_ip                          = 10.0.0.210 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] network_allocate_retries       = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] osapi_compute_listen_port      = 8774 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] osapi_compute_unique_server_name_scope =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] osapi_compute_workers          = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] password_length                = 12 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] periodic_enable                = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] periodic_fuzzy_delay           = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] pointer_model                  = ps2mouse {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] preallocate_images             = none {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] publish_errors                 = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] pybasedir                      = /opt/stack/nova {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ram_allocation_ratio           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rate_limit_burst               = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rate_limit_except_level        = CRITICAL {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rate_limit_interval            = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reboot_timeout                 = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reclaim_instance_interval      = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] record                         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reimage_timeout_per_gb         = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] report_interval                = 120 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rescue_timeout                 = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reserved_host_cpus             = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reserved_host_disk_mb          = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reserved_host_memory_mb        = 512 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] reserved_huge_pages            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] resize_confirm_window          = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] resize_fs_using_block_device   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] resume_guests_state_on_host_boot = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rpc_response_timeout           = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] run_external_periodic_tasks    = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] running_deleted_instance_action = reap {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] running_deleted_instance_timeout = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler_instance_sync_interval = 120 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_down_time              = 720 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] servicegroup_driver            = db {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] shelved_offload_time           = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] shelved_poll_interval          = 3600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] shutdown_timeout               = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] source_is_ipv6                 = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ssl_only                       = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] state_path                     = /opt/stack/data/nova {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] sync_power_state_interval      = 600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] sync_power_state_pool_size     = 1000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] syslog_log_facility            = LOG_USER {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] tempdir                        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] timeout_nbd                    = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] transport_url                  = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] update_resources_interval      = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_cow_images                 = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_eventlog                   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_journal                    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_json                       = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_rootwrap_daemon            = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_stderr                     = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] use_syslog                     = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vcpu_pin_set                   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plugging_is_fatal          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plugging_timeout           = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] virt_mkfs                      = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] volume_usage_poll_interval     = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] watch_log_file                 = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] web                            = /usr/share/spice-html5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_concurrency.disable_process_locking = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.auth_strategy              = keystone {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.compute_link_prefix        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.dhcp_domain                = novalocal {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.enable_instance_password   = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.glance_link_prefix         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.instance_list_per_project_cells = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.list_records_by_skipping_down_cells = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.local_metadata_per_cell    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.max_limit                  = 1000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.metadata_cache_expiration  = 15 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.neutron_default_tenant_id  = default {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.use_forwarded_for          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.use_neutron_default_nets   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_dynamic_targets = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_jsonfile_path   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.backend_argument         = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.config_prefix            = cache.oslo {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.dead_timeout             = 60.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.debug_cache_backend      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.enable_retry_client      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.enable_socket_keepalive  = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.enabled                  = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.expiration_time          = 600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.hashclient_retry_attempts = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_dead_retry      = 300 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_password        =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_sasl_enabled    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.memcache_username        =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.proxies                  = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.retry_attempts           = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.retry_delay              = 0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.socket_keepalive_count   = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.socket_keepalive_idle    = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.socket_keepalive_interval = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.tls_allowed_ciphers      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.tls_cafile               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.tls_certfile             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.tls_enabled              = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cache.tls_keyfile              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.auth_section            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.auth_type               = password {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.cafile                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.certfile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.collect_timing          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.cross_az_attach         = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.debug                   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.endpoint_template       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.http_retries            = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.insecure                = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.keyfile                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.os_region_name          = RegionOne {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.split_loggers           = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cinder.timeout                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.cpu_dedicated_set      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.cpu_shared_set         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.image_type_exclude_list = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.resource_provider_association_refresh = 300 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.shutdown_retry_interval = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] conductor.workers              = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] console.allowed_origins        = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] console.ssl_ciphers            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] console.ssl_minimum_version    = default {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] consoleauth.token_ttl          = 600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.cafile                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.certfile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.collect_timing          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.connect_retries         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.connect_retry_delay     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.endpoint_override       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.insecure                = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.keyfile                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.max_version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.min_version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.region_name             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.service_name            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.service_type            = accelerator {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.split_loggers           = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.status_code_retries     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.timeout                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] cyborg.version                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.backend               = sqlalchemy {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.connection            = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.connection_debug      = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.connection_parameters =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.connection_recycle_time = 3600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.connection_trace      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.db_inc_retry_interval = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.db_max_retries        = 20 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.db_max_retry_interval = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.db_retry_interval     = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.max_overflow          = 50 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.max_pool_size         = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.max_retries           = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.mysql_wsrep_sync_wait = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.pool_timeout          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.retry_interval        = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.slave_connection      = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] database.sqlite_synchronous    = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.backend           = sqlalchemy {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.connection        = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.connection_debug  = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.connection_parameters =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.connection_recycle_time = 3600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.connection_trace  = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.db_inc_retry_interval = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.db_max_retries    = 20 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.db_max_retry_interval = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.db_retry_interval = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.max_overflow      = 50 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.max_pool_size     = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.max_retries       = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.pool_timeout      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.retry_interval    = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.slave_connection  = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] api_database.sqlite_synchronous = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] devices.enabled_mdev_types     = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ephemeral_storage_encryption.enabled = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.api_servers             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.cafile                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.certfile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.collect_timing          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.connect_retries         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.connect_retry_delay     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.debug                   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.default_trusted_certificate_ids = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.enable_certificate_validation = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.enable_rbd_download     = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.endpoint_override       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.insecure                = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.keyfile                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.max_version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.min_version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.num_retries             = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.rbd_ceph_conf           =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.rbd_connect_timeout     = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.rbd_pool                =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.rbd_user                =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.region_name             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.service_name            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.service_type            = image {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.split_loggers           = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.status_code_retries     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.timeout                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.verify_glance_signatures = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] glance.version                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] guestfs.debug                  = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.config_drive_cdrom      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.config_drive_inject_password = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.enable_remotefx         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.instances_path_share    =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.limit_cpu_features      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.use_multipath_io        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.vswitch_name            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] mks.enabled                    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] image_cache.manager_interval   = 2400 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] image_cache.precache_concurrency = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] image_cache.remove_unused_base_images = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] image_cache.subdirectory_name  = _base {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.api_max_retries         = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.api_retry_interval      = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.auth_section            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.auth_type               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.cafile                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.certfile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.collect_timing          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.conductor_group         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.connect_retries         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.connect_retry_delay     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.endpoint_override       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.insecure                = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.keyfile                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.max_version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.min_version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.peer_list               = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.region_name             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.serial_console_state_timeout = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.service_name            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.service_type            = baremetal {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.split_loggers           = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.status_code_retries     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.timeout                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ironic.version                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] key_manager.fixed_key          = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.barbican_api_version  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.barbican_endpoint     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.barbican_endpoint_type = public {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.barbican_region_name  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.cafile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.certfile              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.collect_timing        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.insecure              = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.keyfile               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.number_of_retries     = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.retry_delay           = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.send_service_user_token = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.split_loggers         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.timeout               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.verify_ssl            = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican.verify_ssl_path       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.auth_section = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.auth_type = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.cafile   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.certfile = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.collect_timing = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.insecure = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.keyfile  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.split_loggers = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] barbican_service_user.timeout  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.approle_role_id          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.approle_secret_id        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.cafile                   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.certfile                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.collect_timing           = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.insecure                 = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.keyfile                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.kv_mountpoint            = secret {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.kv_path                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.kv_version               = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.namespace                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.root_token_id            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.split_loggers            = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.ssl_ca_crt_file          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.timeout                  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.use_ssl                  = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.auth_section          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.auth_type             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.cafile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.certfile              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.collect_timing        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.connect_retries       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.connect_retry_delay   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.endpoint_override     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.insecure              = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.keyfile               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.max_version           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.min_version           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.region_name           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.service_name          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.service_type          = identity {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.split_loggers         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.status_code_retries   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.timeout               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] keystone.version               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.connection_uri         =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_mode               = custom {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: WARNING oslo_config.cfg [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_power_governor_high = performance {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_power_management   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.device_detach_attempts = 8 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.device_detach_timeout  = 20 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.disk_cachemodes        = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.disk_prefix            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.enabled_perf_events    = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.file_backed_memory     = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.gid_maps               = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.hw_disk_discard        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.hw_machine_type        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_rbd_pool        = rbd {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_type            = default {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.images_volume_group    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.inject_key             = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.inject_partition       = -2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.inject_password        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.iscsi_iface            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.iser_use_multipath     = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_downtime = 500 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_inbound_addr = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_scheme  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_timeout_action = abort {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_tunnelled = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: WARNING oslo_config.cfg [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 23 15:17:29 user nova-compute[74421]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 23 15:17:29 user nova-compute[74421]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 23 15:17:29 user nova-compute[74421]: and ``live_migration_inbound_addr`` respectively.
Oct 23 15:17:29 user nova-compute[74421]: ).  Its value may be silently ignored in the future.
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.live_migration_with_native_tls = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.max_queues             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.nfs_mount_options      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.num_pcie_ports         = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.pmem_namespaces        = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.quobyte_client_cfg     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rbd_secret_uuid        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rbd_user               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rescue_image_id        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rescue_kernel_id       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.rx_queue_size          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.smbfs_mount_options    =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.snapshot_compression   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.snapshot_image_format  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.sparse_logical_volumes = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.swtpm_enabled          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.swtpm_group            = tss {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.swtpm_user             = tss {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.sysinfo_serial         = unique {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.tb_cache_size          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.tx_queue_size          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.uid_maps               = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.use_virtio_for_bridges = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.virt_type              = kvm {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.volume_clear           = zero {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.volume_clear_size      = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.volume_use_multipath   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_cache_path   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.auth_section           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.auth_type              = password {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.cafile                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.certfile               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.collect_timing         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.connect_retries        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.connect_retry_delay    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.default_floating_pool  = public {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.endpoint_override      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.extension_sync_interval = 600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.http_retries           = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.insecure               = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.keyfile                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.max_version            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.min_version            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.ovs_bridge             = br-int {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.physnets               = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.region_name            = RegionOne {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.service_metadata_proxy = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.service_name           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.service_type           = network {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.split_loggers          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.status_code_retries    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.timeout                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] neutron.version                = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] notifications.bdms_in_notifications = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] notifications.default_level    = INFO {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] notifications.notification_format = unversioned {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] notifications.notify_on_state_change = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] pci.alias                      = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] pci.device_spec                = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] pci.report_in_placement        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.auth_section         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.auth_type            = password {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.cafile               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.certfile             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.collect_timing       = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.connect_retries      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.connect_retry_delay  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.default_domain_id    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.default_domain_name  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.domain_id            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.domain_name          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.endpoint_override    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.insecure             = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.keyfile              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.max_version          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.min_version          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.password             = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.project_domain_id    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.project_domain_name  = Default {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.project_id           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.project_name         = service {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.region_name          = RegionOne {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.service_name         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.service_type         = placement {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.split_loggers        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.status_code_retries  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.system_scope         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.timeout              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.trust_id             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.user_domain_id       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.user_domain_name     = Default {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.user_id              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.username             = placement {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] placement.version              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.cores                    = 20 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.count_usage_from_placement = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.injected_file_content_bytes = 10240 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.injected_file_path_length = 255 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.injected_files           = 5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.instances                = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.key_pairs                = 100 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.metadata_items           = 128 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.ram                      = 51200 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.recheck_quota            = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.server_group_members     = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] quota.server_groups            = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rdp.enabled                    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.image_metadata_prefilter = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.max_attempts         = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.max_placement_results = 1000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] scheduler.workers              = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.host_subset_size = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.isolated_hosts = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.isolated_images = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.pci_in_placement = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.track_instance_changes = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metrics.required               = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metrics.weight_multiplier      = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] metrics.weight_setting         = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] serial_console.enabled         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] serial_console.port_range      = 10000:20000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] serial_console.serialproxy_port = 6083 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.auth_section      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.auth_type         = password {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.cafile            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.certfile          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.collect_timing    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.insecure          = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.keyfile           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.send_service_user_token = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.split_loggers     = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] service_user.timeout           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.agent_enabled            = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.enabled                  = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.html5proxy_port          = 6082 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.image_compression        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.jpeg_compression         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.playback_compression     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.server_listen            = 127.0.0.1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.streaming_mode           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] spice.zlib_compression         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] upgrade_levels.baseapi         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] upgrade_levels.cert            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] upgrade_levels.compute         = auto {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] upgrade_levels.conductor       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] upgrade_levels.scheduler       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.cafile = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.certfile = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.insecure = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vendordata_dynamic_auth.timeout = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.api_retry_count         = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.ca_file                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.cache_prefix            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.cluster_name            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.connection_pool_size    = 10 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.console_delay_seconds   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.datastore_regex         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.host_ip                 = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.host_password           = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.host_port               = 443 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.host_username           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.insecure                = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.integration_bridge      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.maximum_objects         = 100 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.pbm_default_policy      = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.pbm_enabled             = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.pbm_wsdl_location       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.serial_port_proxy_uri   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.serial_port_service_uri = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.task_poll_interval      = 0.5 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.use_linked_clone        = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.vnc_keymap              = en-us {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.vnc_port                = 5900 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vmware.vnc_port_total          = 10000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.auth_schemes               = ['none'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.enabled                    = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.novncproxy_port            = 6080 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.vencrypt_ca_certs          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.vencrypt_client_cert       = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vnc.vencrypt_client_key        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.disable_rootwrap   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.enable_numa_live_migration = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.libvirt_disable_apic = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.client_socket_timeout     = 900 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.default_pool_size         = 1000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.keep_alive                = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.max_header_line           = 16384 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.ssl_ca_file               = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.ssl_cert_file             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.ssl_key_file              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.tcp_keepidle              = 600 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] zvm.ca_file                    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] zvm.cloud_connector_url        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] zvm.reachable_timeout          = 300 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.enforce_new_defaults = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.enforce_scope      = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.policy_default_rule = default {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.connection_string     = messaging:// {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.enabled               = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.es_doc_type           = notification {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.es_scroll_size        = 10000 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.es_scroll_time        = 2m {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.filter_error_trace    = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.hmac_keys             = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.sentinel_service_name = mymaster {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.socket_timeout        = 0.1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.trace_requests        = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler.trace_sqlalchemy      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler_jaeger.process_tags   = {} {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler_jaeger.service_name_prefix = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] profiler_otlp.service_name_prefix = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] remote_debug.host              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] remote_debug.port              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_notifications.retry = -1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.auth_section        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.auth_type           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.cafile              = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.certfile            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.collect_timing      = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.connect_retries     = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.connect_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.endpoint_id         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.endpoint_override   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.insecure            = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.keyfile             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.max_version         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.min_version         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.region_name         = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.service_name        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.service_type        = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.split_loggers       = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.status_code_retries = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.status_code_retry_delay = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.timeout             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.valid_interfaces    = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_limit.version             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_reports.file_event_handler = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] oslo_reports.log_dir           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_ovs_privileged.group  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] vif_plug_ovs_privileged.user   = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.isolate_vif         = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] os_brick.lock_path             = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] privsep_osbrick.capabilities   = [21] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] privsep_osbrick.group          = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] privsep_osbrick.helper_command = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] privsep_osbrick.user           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] nova_sys_admin.group           = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] nova_sys_admin.helper_command  = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] nova_sys_admin.user            = None {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG oslo_service.service [None req-5aa74f04-efdd-4247-a897-a90535d7563e None None] ******************************************************************************** {{(pid=74421) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 23 15:17:29 user nova-compute[74421]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Connecting to libvirt: qemu:///system {{(pid=74421) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f24810d6530> {{(pid=74421) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 23 15:17:29 user nova-compute[74421]: libvirt:  error : internal error: could not initialize domain event timer
Oct 23 15:17:29 user nova-compute[74421]: WARNING nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f24810d6530> {{(pid=74421) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Starting native event thread {{(pid=74421) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Starting green dispatch thread {{(pid=74421) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Starting connection event dispatch thread {{(pid=74421) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 23 15:17:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Connection event '1' reason 'None'
Oct 23 15:17:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 15:17:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.mount [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Initialising _HostMountState generation 0 {{(pid=74421) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 23 15:17:36 user nova-compute[74421]: INFO nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host capabilities <capabilities>
Oct 23 15:17:36 user nova-compute[74421]:   <host>
Oct 23 15:17:36 user nova-compute[74421]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 23 15:17:36 user nova-compute[74421]:     <cpu>
Oct 23 15:17:36 user nova-compute[74421]:       <arch>x86_64</arch>
Oct 23 15:17:36 user nova-compute[74421]:       <model>IvyBridge-IBRS</model>
Oct 23 15:17:36 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:36 user nova-compute[74421]:       <microcode version='1070'/>
Oct 23 15:17:36 user nova-compute[74421]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 23 15:17:36 user nova-compute[74421]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='ss'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='vmx'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='pcid'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='osxsave'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='hypervisor'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='arat'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='tsc_adjust'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='md-clear'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='stibp'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='arch-capabilities'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='ssbd'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='invtsc'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='rsba'/>
Oct 23 15:17:36 user nova-compute[74421]:       <feature name='skip-l1dfl-vmentry'/>
Oct 23 15:17:36 user nova-compute[74421]:       <pages unit='KiB' size='4'/>
Oct 23 15:17:36 user nova-compute[74421]:       <pages unit='KiB' size='2048'/>
Oct 23 15:17:36 user nova-compute[74421]:     </cpu>
Oct 23 15:17:36 user nova-compute[74421]:     <power_management>
Oct 23 15:17:36 user nova-compute[74421]:       <suspend_mem/>
Oct 23 15:17:36 user nova-compute[74421]:       <suspend_disk/>
Oct 23 15:17:36 user nova-compute[74421]:       <suspend_hybrid/>
Oct 23 15:17:36 user nova-compute[74421]:     </power_management>
Oct 23 15:17:36 user nova-compute[74421]:     <iommu support='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     <migration_features>
Oct 23 15:17:36 user nova-compute[74421]:       <live/>
Oct 23 15:17:36 user nova-compute[74421]:       <uri_transports>
Oct 23 15:17:36 user nova-compute[74421]:         <uri_transport>tcp</uri_transport>
Oct 23 15:17:36 user nova-compute[74421]:         <uri_transport>rdma</uri_transport>
Oct 23 15:17:36 user nova-compute[74421]:       </uri_transports>
Oct 23 15:17:36 user nova-compute[74421]:     </migration_features>
Oct 23 15:17:36 user nova-compute[74421]:     <topology>
Oct 23 15:17:36 user nova-compute[74421]:       <cells num='2'>
Oct 23 15:17:36 user nova-compute[74421]:         <cell id='0'>
Oct 23 15:17:36 user nova-compute[74421]:           <memory unit='KiB'>8189224</memory>
Oct 23 15:17:36 user nova-compute[74421]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 23 15:17:36 user nova-compute[74421]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 15:17:36 user nova-compute[74421]:           <distances>
Oct 23 15:17:36 user nova-compute[74421]:             <sibling id='0' value='10'/>
Oct 23 15:17:36 user nova-compute[74421]:             <sibling id='1' value='20'/>
Oct 23 15:17:36 user nova-compute[74421]:           </distances>
Oct 23 15:17:36 user nova-compute[74421]:           <cpus num='6'>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 23 15:17:36 user nova-compute[74421]:           </cpus>
Oct 23 15:17:36 user nova-compute[74421]:         </cell>
Oct 23 15:17:36 user nova-compute[74421]:         <cell id='1'>
Oct 23 15:17:36 user nova-compute[74421]:           <memory unit='KiB'>8206460</memory>
Oct 23 15:17:36 user nova-compute[74421]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 23 15:17:36 user nova-compute[74421]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 15:17:36 user nova-compute[74421]:           <distances>
Oct 23 15:17:36 user nova-compute[74421]:             <sibling id='0' value='20'/>
Oct 23 15:17:36 user nova-compute[74421]:             <sibling id='1' value='10'/>
Oct 23 15:17:36 user nova-compute[74421]:           </distances>
Oct 23 15:17:36 user nova-compute[74421]:           <cpus num='6'>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 23 15:17:36 user nova-compute[74421]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 23 15:17:36 user nova-compute[74421]:           </cpus>
Oct 23 15:17:36 user nova-compute[74421]:         </cell>
Oct 23 15:17:36 user nova-compute[74421]:       </cells>
Oct 23 15:17:36 user nova-compute[74421]:     </topology>
Oct 23 15:17:36 user nova-compute[74421]:     <cache>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 23 15:17:36 user nova-compute[74421]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 23 15:17:36 user nova-compute[74421]:     </cache>
Oct 23 15:17:36 user nova-compute[74421]:     <secmodel>
Oct 23 15:17:36 user nova-compute[74421]:       <model>apparmor</model>
Oct 23 15:17:36 user nova-compute[74421]:       <doi>0</doi>
Oct 23 15:17:36 user nova-compute[74421]:     </secmodel>
Oct 23 15:17:36 user nova-compute[74421]:     <secmodel>
Oct 23 15:17:36 user nova-compute[74421]:       <model>dac</model>
Oct 23 15:17:36 user nova-compute[74421]:       <doi>0</doi>
Oct 23 15:17:36 user nova-compute[74421]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 23 15:17:36 user nova-compute[74421]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 23 15:17:36 user nova-compute[74421]:     </secmodel>
Oct 23 15:17:36 user nova-compute[74421]:   </host>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='alpha'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>clipper</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:36 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:36 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     </features>
Oct 23 15:17:36 user nova-compute[74421]:   </guest>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='armv6l'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>spitz</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>nuri</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>kzm</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sx1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>z2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>tosa</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>n810</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>n800</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>terrier</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>midway</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>microbit</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>verdex</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>highbank</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>akita</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>connex</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>collie</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:36 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:36 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     </features>
Oct 23 15:17:36 user nova-compute[74421]:   </guest>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='armv7l'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>spitz</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>nuri</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>kzm</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sx1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>z2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>tosa</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>n810</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>n800</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>terrier</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>midway</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>microbit</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>verdex</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>highbank</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>akita</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>connex</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>collie</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:36 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:36 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     </features>
Oct 23 15:17:36 user nova-compute[74421]:   </guest>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='aarch64'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>spitz</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>nuri</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>kzm</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sx1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>z2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>tosa</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>n810</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>n800</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>terrier</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>midway</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>microbit</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>verdex</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>raspi3b</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='4'>highbank</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>akita</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>connex</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>collie</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <acpi default='on' toggle='yes'/>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:36 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:36 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     </features>
Oct 23 15:17:36 user nova-compute[74421]:   </guest>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='cris'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:36 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:36 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     </features>
Oct 23 15:17:36 user nova-compute[74421]:   </guest>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='i686'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>isapc</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>microvm</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='kvm'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <pae/>
Oct 23 15:17:36 user nova-compute[74421]:       <nonpae/>
Oct 23 15:17:36 user nova-compute[74421]:       <acpi default='on' toggle='yes'/>
Oct 23 15:17:36 user nova-compute[74421]:       <apic default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:36 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:36 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:36 user nova-compute[74421]:     </features>
Oct 23 15:17:36 user nova-compute[74421]:   </guest>
Oct 23 15:17:36 user nova-compute[74421]:   <guest>
Oct 23 15:17:36 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:36 user nova-compute[74421]:     <arch name='m68k'>
Oct 23 15:17:36 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:36 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>an5206</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>q800</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>next-cube</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 23 15:17:36 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:36 user nova-compute[74421]:     </arch>
Oct 23 15:17:36 user nova-compute[74421]:     <features>
Oct 23 15:17:36 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='microblaze'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='microblazeel'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='mips'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='16'>malta</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='mipsel'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='16'>malta</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='mips64'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='16'>malta</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>pica61</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>magnum</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='mips64el'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='16'>malta</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>pica61</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>magnum</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='16'>boston</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='ppc'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mac99</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>40p</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>taihu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='ppc64'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>taihu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>40p</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mac99</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='ppc64le'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>taihu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>40p</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>mac99</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='riscv32'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='8'>spike</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>opentitan</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='8'>virt</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='riscv64'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='8'>spike</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>shakti_c</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='8'>virt</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='s390x'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='sh4'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>shix</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>r2d</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='sh4eb'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>shix</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>r2d</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='sparc'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>SS-5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='4'>SS-20</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>LX</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>SS-4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='4'>SS-10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>Voyager</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='sparc64'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sun4u</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>niagara</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>sun4v</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='x86_64'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>64</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='1'>isapc</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>microvm</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='kvm'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <acpi default='on' toggle='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:       <apic default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='xtensa'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='4'>sim</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>kc705</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ml605</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>virt</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx200</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx60</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]:   <guest>
Oct 23 15:17:37 user nova-compute[74421]:     <os_type>hvm</os_type>
Oct 23 15:17:37 user nova-compute[74421]:     <arch name='xtensaeb'>
Oct 23 15:17:37 user nova-compute[74421]:       <wordsize>32</wordsize>
Oct 23 15:17:37 user nova-compute[74421]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='4'>sim</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>kc705</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ml605</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>virt</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx200</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>lx60</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 15:17:37 user nova-compute[74421]:       <domain type='qemu'/>
Oct 23 15:17:37 user nova-compute[74421]:     </arch>
Oct 23 15:17:37 user nova-compute[74421]:     <features>
Oct 23 15:17:37 user nova-compute[74421]:       <cpuselection/>
Oct 23 15:17:37 user nova-compute[74421]:       <deviceboot/>
Oct 23 15:17:37 user nova-compute[74421]:       <disksnapshot default='on' toggle='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     </features>
Oct 23 15:17:37 user nova-compute[74421]:   </guest>
Oct 23 15:17:37 user nova-compute[74421]: </capabilities>
Oct 23 15:17:37 user nova-compute[74421]: 
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-q35-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>i686</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='288'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'/>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='lm'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-i440fx-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>i686</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='255'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'/>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='lm'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ide</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-q35-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>i686</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='288'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'/>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='lm'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-i440fx-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>i686</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='255'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'/>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='lm'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ide</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-q35-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>x86_64</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='288'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>efi</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='invtsc'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='rsba'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-i440fx-6.2</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>x86_64</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='255'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>efi</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='invtsc'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='rsba'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ide</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-q35-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>x86_64</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='288'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>efi</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='invtsc'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='rsba'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 23 15:17:37 user nova-compute[74421]: <domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 15:17:37 user nova-compute[74421]:   <domain>kvm</domain>
Oct 23 15:17:37 user nova-compute[74421]:   <machine>pc-i440fx-jammy</machine>
Oct 23 15:17:37 user nova-compute[74421]:   <arch>x86_64</arch>
Oct 23 15:17:37 user nova-compute[74421]:   <vcpu max='255'/>
Oct 23 15:17:37 user nova-compute[74421]:   <iothreads supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:   <os supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='firmware'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>efi</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:     <loader supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>rom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pflash</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='readonly'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>yes</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='secure'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>no</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </loader>
Oct 23 15:17:37 user nova-compute[74421]:   </os>
Oct 23 15:17:37 user nova-compute[74421]:   <cpu>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-passthrough' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='hostPassthroughMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='maximum' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='maximumMigratable'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>on</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>off</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='host-model' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <vendor>Intel</vendor>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ss'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='vmx'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pcid'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='hypervisor'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arat'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='umip'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='md-clear'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='invtsc'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibpb'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='ibrs'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-stibp'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='rsba'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='erms'/>
Oct 23 15:17:37 user nova-compute[74421]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:     <mode name='custom' supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>qemu64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>qemu32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>phenom</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>pentium</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>n270</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm64</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>kvm32</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>coreduo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>core2duo</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>athlon</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Westmere</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Snowridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Skylake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>SandyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Penryn</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G5</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G4</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G3</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Opteron_G2</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Opteron_G1</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>IvyBridge</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Icelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Haswell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Rome</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-Milan</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>EPYC</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Dhyana</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cooperlake</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>Conroe</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='no'>Broadwell</model>
Oct 23 15:17:37 user nova-compute[74421]:       <model usable='yes'>486</model>
Oct 23 15:17:37 user nova-compute[74421]:     </mode>
Oct 23 15:17:37 user nova-compute[74421]:   </cpu>
Oct 23 15:17:37 user nova-compute[74421]:   <memoryBacking supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:     <enum name='sourceType'>
Oct 23 15:17:37 user nova-compute[74421]:       <value>file</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>anonymous</value>
Oct 23 15:17:37 user nova-compute[74421]:       <value>memfd</value>
Oct 23 15:17:37 user nova-compute[74421]:     </enum>
Oct 23 15:17:37 user nova-compute[74421]:   </memoryBacking>
Oct 23 15:17:37 user nova-compute[74421]:   <devices>
Oct 23 15:17:37 user nova-compute[74421]:     <disk supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='diskDevice'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>disk</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cdrom</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>floppy</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>lun</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='bus'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ide</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>fdc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sata</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </disk>
Oct 23 15:17:37 user nova-compute[74421]:     <graphics supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='type'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>sdl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vnc</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>spice</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egl-headless</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </graphics>
Oct 23 15:17:37 user nova-compute[74421]:     <video supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='modelType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>cirrus</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>vmvga</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>qxl</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>none</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>bochs</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>ramfb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </video>
Oct 23 15:17:37 user nova-compute[74421]:     <hostdev supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='mode'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>subsystem</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='startupPolicy'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>default</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>mandatory</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>requisite</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>optional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='subsysType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>usb</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>pci</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>scsi</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='capsType'/>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='pciBackend'/>
Oct 23 15:17:37 user nova-compute[74421]:     </hostdev>
Oct 23 15:17:37 user nova-compute[74421]:     <rng supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtio-non-transitional</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>random</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>egd</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>builtin</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </rng>
Oct 23 15:17:37 user nova-compute[74421]:     <filesystem supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='driverType'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>path</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>handle</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>virtiofs</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </filesystem>
Oct 23 15:17:37 user nova-compute[74421]:     <tpm supported='yes'>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='model'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-tis</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>tpm-crb</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:       <enum name='backendModel'>
Oct 23 15:17:37 user nova-compute[74421]:         <value>passthrough</value>
Oct 23 15:17:37 user nova-compute[74421]:         <value>emulator</value>
Oct 23 15:17:37 user nova-compute[74421]:       </enum>
Oct 23 15:17:37 user nova-compute[74421]:     </tpm>
Oct 23 15:17:37 user nova-compute[74421]:   </devices>
Oct 23 15:17:37 user nova-compute[74421]:   <features>
Oct 23 15:17:37 user nova-compute[74421]:     <gic supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:     <vmcoreinfo supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <genid supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backingStoreInput supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <backup supported='yes'/>
Oct 23 15:17:37 user nova-compute[74421]:     <sev supported='no'/>
Oct 23 15:17:37 user nova-compute[74421]:   </features>
Oct 23 15:17:37 user nova-compute[74421]: </domainCapabilities>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74421) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74421) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Checking secure boot support for host arch (x86_64) {{(pid=74421) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 15:17:37 user nova-compute[74421]: INFO nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Secure Boot support detected
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] cpu compare xml: <cpu match="exact">
Oct 23 15:17:37 user nova-compute[74421]:   <model>Nehalem</model>
Oct 23 15:17:37 user nova-compute[74421]: </cpu>
Oct 23 15:17:37 user nova-compute[74421]:  {{(pid=74421) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 23 15:17:37 user nova-compute[74421]: INFO nova.virt.node [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Generated node identity a41abbd0-486b-47b6-812b-369e07ceaa0f
Oct 23 15:17:37 user nova-compute[74421]: INFO nova.virt.node [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Wrote node identity a41abbd0-486b-47b6-812b-369e07ceaa0f to /opt/stack/data/nova/compute_id
Oct 23 15:17:37 user nova-compute[74421]: WARNING nova.compute.manager [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Compute nodes ['a41abbd0-486b-47b6-812b-369e07ceaa0f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 23 15:17:37 user nova-compute[74421]: INFO nova.compute.manager [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 23 15:17:37 user nova-compute[74421]: WARNING nova.compute.manager [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 15:17:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:17:37 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:17:37 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Hypervisor/Node resource view: name=user free_ram=10993MB free_disk=26.09307098388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:17:37 user nova-compute[74421]: WARNING nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] No compute node record for user:a41abbd0-486b-47b6-812b-369e07ceaa0f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a41abbd0-486b-47b6-812b-369e07ceaa0f could not be found.
Oct 23 15:17:37 user nova-compute[74421]: INFO nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Compute node record created for user:user with uuid: a41abbd0-486b-47b6-812b-369e07ceaa0f
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:17:37 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:17:38 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] [req-2ff3d490-9b2f-46e3-adb5-66378a27901c] Created resource provider record via placement API for resource provider with UUID a41abbd0-486b-47b6-812b-369e07ceaa0f and name user.
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74421) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 23 15:17:38 user nova-compute[74421]: INFO nova.virt.libvirt.host [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] kernel doesn't support AMD SEV
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Libvirt baseline CPU <cpu>
Oct 23 15:17:38 user nova-compute[74421]:   <arch>x86_64</arch>
Oct 23 15:17:38 user nova-compute[74421]:   <model>Nehalem</model>
Oct 23 15:17:38 user nova-compute[74421]:   <vendor>Intel</vendor>
Oct 23 15:17:38 user nova-compute[74421]:   <topology sockets="6" cores="1" threads="1"/>
Oct 23 15:17:38 user nova-compute[74421]: </cpu>
Oct 23 15:17:38 user nova-compute[74421]:  {{(pid=74421) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Updated inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Updating resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f generation from 0 to 1 during operation: update_inventory {{(pid=74421) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Updating resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f generation from 1 to 2 during operation: update_traits {{(pid=74421) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.service [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Creating RPC server for service compute {{(pid=74421) start /opt/stack/nova/nova/service.py:182}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.service [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] Join ServiceGroup membership for this service compute {{(pid=74421) start /opt/stack/nova/nova/service.py:199}}
Oct 23 15:17:38 user nova-compute[74421]: DEBUG nova.servicegroup.drivers.db [None req-d353ff94-0531-48d5-ba99-ea61402dbbea None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74421) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 23 15:18:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:18:28 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:18:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:18:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:18:29 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=10431MB free_disk=25.99681854248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:18:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:19:29 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:19:30 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:19:30 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:19:30 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=10342MB free_disk=26.061100006103516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:19:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:19:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:19:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:20:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:20:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:20:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:20:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:20:31 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:20:32 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:20:32 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:20:32 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=10352MB free_disk=25.81446075439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:20:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:20:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:21:32 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:33 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:21:34 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:34 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9615MB free_disk=25.834335327148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:34 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:21:34 user nova-compute[74421]: INFO nova.compute.claims [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Claim successful on node user
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:21:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:21:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Creating image(s)
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "/opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "/opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "/opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:36 user nova-compute[74421]: DEBUG nova.policy [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ecc4a733599474d926e8feeda4e9328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1b4d9c12e94c4fa438af397abcff40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:21:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.part --force-share --output=json" returned: 0 in 0.228s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:36 user nova-compute[74421]: DEBUG nova.virt.images [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] 8df87536-9d51-4582-bc16-f205abcf2ad4 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:21:36 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:21:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.part /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.part /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.converted" returned: 0 in 0.243s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.771s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:37 user nova-compute[74421]: INFO oslo.privsep.daemon [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpttk4c4c2/privsep.sock']
Oct 23 15:21:37 user sudo[83649]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpttk4c4c2/privsep.sock
Oct 23 15:21:37 user sudo[83649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 15:21:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Successfully created port: 3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:21:38 user sudo[83649]: pam_unix(sudo:session): session closed for user root
Oct 23 15:21:39 user nova-compute[74421]: INFO oslo.privsep.daemon [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Spawned new privsep daemon via rootwrap
Oct 23 15:21:39 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 15:21:39 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 15:21:39 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 23 15:21:39 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83655
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.234s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.167s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk 1073741824" returned: 0 in 0.089s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:21:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Cannot resize image /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Ensure instance console log exists: /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Successfully updated port: 3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquired lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:21:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-changed-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Refreshing instance network info cache due to event network-changed-3fa2172c-6b73-463e-9ac6-b680d5ba69e1. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] Acquiring lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.network.neutron [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updating instance_info_cache with network_info: [{"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Releasing lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Instance network_info: |[{"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] Acquired lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.network.neutron [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Refreshing network info cache for port 3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Start _get_guest_xml network_info=[{"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:21:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-827624569',display_name='tempest-ServersNegativeTestJSON-server-827624569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-827624569',id=1,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab1b4d9c12e94c4fa438af397abcff40',ramdisk_id='',reservation_id='r-3ud7q00r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-297395355',owner_user_name='tempest-ServersNegativeTestJSON-297395355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:35Z,user_data=None,user_id='4ecc4a733599474d926e8feeda4e9328',uuid=110e0389-5c67-43c8-adff-dc9af9eff34e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converting VIF {"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:41 user nova-compute[74421]: DEBUG nova.objects.instance [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lazy-loading 'pci_devices' on Instance uuid 110e0389-5c67-43c8-adff-dc9af9eff34e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:21:42 user nova-compute[74421]:   <uuid>110e0389-5c67-43c8-adff-dc9af9eff34e</uuid>
Oct 23 15:21:42 user nova-compute[74421]:   <name>instance-00000001</name>
Oct 23 15:21:42 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:21:42 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:21:42 user nova-compute[74421]:   <metadata>
Oct 23 15:21:42 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:21:42 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:21:42 user nova-compute[74421]:       <nova:name>tempest-ServersNegativeTestJSON-server-827624569</nova:name>
Oct 23 15:21:42 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:21:41</nova:creationTime>
Oct 23 15:21:42 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:21:42 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:21:42 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:21:42 user nova-compute[74421]:       <nova:owner>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:user uuid="4ecc4a733599474d926e8feeda4e9328">tempest-ServersNegativeTestJSON-297395355-project-member</nova:user>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:project uuid="ab1b4d9c12e94c4fa438af397abcff40">tempest-ServersNegativeTestJSON-297395355</nova:project>
Oct 23 15:21:42 user nova-compute[74421]:       </nova:owner>
Oct 23 15:21:42 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:21:42 user nova-compute[74421]:       <nova:ports>
Oct 23 15:21:42 user nova-compute[74421]:         <nova:port uuid="3fa2172c-6b73-463e-9ac6-b680d5ba69e1">
Oct 23 15:21:42 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 15:21:42 user nova-compute[74421]:         </nova:port>
Oct 23 15:21:42 user nova-compute[74421]:       </nova:ports>
Oct 23 15:21:42 user nova-compute[74421]:     </nova:instance>
Oct 23 15:21:42 user nova-compute[74421]:   </metadata>
Oct 23 15:21:42 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:21:42 user nova-compute[74421]:     <system>
Oct 23 15:21:42 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:21:42 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:21:42 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:21:42 user nova-compute[74421]:       <entry name="serial">110e0389-5c67-43c8-adff-dc9af9eff34e</entry>
Oct 23 15:21:42 user nova-compute[74421]:       <entry name="uuid">110e0389-5c67-43c8-adff-dc9af9eff34e</entry>
Oct 23 15:21:42 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:21:42 user nova-compute[74421]:     </system>
Oct 23 15:21:42 user nova-compute[74421]:   </sysinfo>
Oct 23 15:21:42 user nova-compute[74421]:   <os>
Oct 23 15:21:42 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:21:42 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:21:42 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:21:42 user nova-compute[74421]:   </os>
Oct 23 15:21:42 user nova-compute[74421]:   <features>
Oct 23 15:21:42 user nova-compute[74421]:     <acpi/>
Oct 23 15:21:42 user nova-compute[74421]:     <apic/>
Oct 23 15:21:42 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:21:42 user nova-compute[74421]:   </features>
Oct 23 15:21:42 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:21:42 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:21:42 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:21:42 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:21:42 user nova-compute[74421]:   </clock>
Oct 23 15:21:42 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:21:42 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:21:42 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:21:42 user nova-compute[74421]:   </cpu>
Oct 23 15:21:42 user nova-compute[74421]:   <devices>
Oct 23 15:21:42 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:21:42 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:21:42 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk"/>
Oct 23 15:21:42 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:21:42 user nova-compute[74421]:     </disk>
Oct 23 15:21:42 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:21:42 user nova-compute[74421]:       <mac address="fa:16:3e:21:bd:1b"/>
Oct 23 15:21:42 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:42 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:21:42 user nova-compute[74421]:       <target dev="tap3fa2172c-6b"/>
Oct 23 15:21:42 user nova-compute[74421]:     </interface>
Oct 23 15:21:42 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:21:42 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/console.log" append="off"/>
Oct 23 15:21:42 user nova-compute[74421]:     </serial>
Oct 23 15:21:42 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:21:42 user nova-compute[74421]:     <video>
Oct 23 15:21:42 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:42 user nova-compute[74421]:     </video>
Oct 23 15:21:42 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:21:42 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:21:42 user nova-compute[74421]:     </rng>
Oct 23 15:21:42 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:21:42 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:21:42 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:21:42 user nova-compute[74421]:     </memballoon>
Oct 23 15:21:42 user nova-compute[74421]:   </devices>
Oct 23 15:21:42 user nova-compute[74421]: </domain>
Oct 23 15:21:42 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-827624569',display_name='tempest-ServersNegativeTestJSON-server-827624569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-827624569',id=1,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab1b4d9c12e94c4fa438af397abcff40',ramdisk_id='',reservation_id='r-3ud7q00r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-297395355',owner_user_name='tempest-ServersNegativeTestJSON-297395355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:35Z,user_data=None,user_id='4ecc4a733599474d926e8feeda4e9328',uuid=110e0389-5c67-43c8-adff-dc9af9eff34e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converting VIF {"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG os_vif [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Created schema index Interface.name {{(pid=74421) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Created schema index Port.name {{(pid=74421) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Created schema index Bridge.name {{(pid=74421) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [POLLOUT] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7baeb0ca-0eed-5acd-8d94-4e953ed331f7', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: INFO oslo.privsep.daemon [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpa46pxgx5/privsep.sock']
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user sudo[83703]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpa46pxgx5/privsep.sock
Oct 23 15:21:42 user sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:43 user nova-compute[74421]: DEBUG nova.network.neutron [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updated VIF entry in instance network info cache for port 3fa2172c-6b73-463e-9ac6-b680d5ba69e1. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:21:43 user nova-compute[74421]: DEBUG nova.network.neutron [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updating instance_info_cache with network_info: [{"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e3ee38b9-1aa7-4e93-b8f4-8113985981a1 req-eea7a4bf-05bc-4145-a9cf-e48961dcfe3c service nova] Releasing lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:43 user sudo[83703]: pam_unix(sudo:session): session closed for user root
Oct 23 15:21:43 user nova-compute[74421]: INFO oslo.privsep.daemon [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Spawned new privsep daemon via rootwrap
Oct 23 15:21:43 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 15:21:43 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 15:21:43 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 23 15:21:43 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83712
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fa2172c-6b, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fa2172c-6b, col_values=(('qos', UUID('b78984df-139f-4277-9978-2988a2ef1378')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fa2172c-6b, col_values=(('external_ids', {'iface-id': '3fa2172c-6b73-463e-9ac6-b680d5ba69e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:bd:1b', 'vm-uuid': '110e0389-5c67-43c8-adff-dc9af9eff34e'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:44 user nova-compute[74421]: INFO os_vif [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b')
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] No VIF found with MAC fa:16:3e:21:bd:1b, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:44 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:21:44 user nova-compute[74421]: INFO nova.compute.claims [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Claim successful on node user
Oct 23 15:21:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.510s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:21:45 user nova-compute[74421]: INFO nova.compute.claims [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Claim successful on node user
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:21:45 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:21:45 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Creating image(s)
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "/opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "/opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:45 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.policy [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4cdf16d4f324a4dba27657c6c6d4a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6cc6b03c90249999ab8c6f3eb605c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.182s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:21:46 user nova-compute[74421]: INFO nova.compute.claims [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Claim successful on node user
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.216s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk 1073741824" returned: 0 in 0.066s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:21:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Creating image(s)
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "/opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.policy [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e711d55fe644a0ca518fa34d187b79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e90bcb97e74feaa5e6247b7fc0d3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.066s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:21:46 user nova-compute[74421]: INFO nova.compute.claims [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Claim successful on node user
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Cannot resize image /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Ensure instance console log exists: /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk 1073741824" returned: 0 in 0.062s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.policy [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182146bec4cf473ab9e025bca5a74371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0053dc54a1e44f18966d687a2bb42e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:21:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Creating image(s)
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "/opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "/opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "/opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.247s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.670s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:21:47 user nova-compute[74421]: INFO nova.compute.claims [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Claim successful on node user
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Cannot resize image /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Ensure instance console log exists: /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:21:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.237s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk 1073741824" returned: 0 in 0.066s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:21:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Creating image(s)
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG nova.policy [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce501ef5d45c43efa6fd1329bd1b417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd7efc2de094cc6b45ebe7e14aceecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Cannot resize image /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Ensure instance console log exists: /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.164s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk 1073741824" returned: 0 in 0.072s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:48 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:21:48 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Instance spawned successfully.
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Successfully created port: 1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.239s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.policy [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '166776dcccda43409673d99af45d4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733f39c7c95492abc827bd581ca7afa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:21:48 user nova-compute[74421]: INFO nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Took 12.96 seconds to spawn the instance on the hypervisor.
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:21:48 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Creating image(s)
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "/opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:48 user nova-compute[74421]: INFO nova.compute.manager [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Took 13.84 seconds to build instance.
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Cannot resize image /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Ensure instance console log exists: /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da8ee664-e5ae-4a4b-9f1d-b551eb4ad502 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.182s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.260s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Successfully created port: 4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk 1073741824" returned: 0 in 0.072s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.280s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG nova.network.neutron [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Successfully created port: 84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Cannot resize image /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Ensure instance console log exists: /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:21:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:21:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:50 user nova-compute[74421]: DEBUG nova.network.neutron [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Successfully created port: 71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:21:50 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Successfully updated port: 4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-changed-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Refreshing instance network info cache due to event network-changed-4601ea46-2069-471a-8de8-0547b9aea8c9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Successfully created port: 7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Instance network_info: |[{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.neutron [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Refreshing network info cache for port 4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Start _get_guest_xml network_info=[{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:21:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-960484498',display_name='tempest-ServerActionsTestOtherA-server-960484498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-960484498',id=4,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-24pj4n4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=797f85e1-87ce-4295-8e14-19fd0919f2a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.objects.instance [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'pci_devices' on Instance uuid 797f85e1-87ce-4295-8e14-19fd0919f2a0 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:21:52 user nova-compute[74421]:   <uuid>797f85e1-87ce-4295-8e14-19fd0919f2a0</uuid>
Oct 23 15:21:52 user nova-compute[74421]:   <name>instance-00000004</name>
Oct 23 15:21:52 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:21:52 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:21:52 user nova-compute[74421]:   <metadata>
Oct 23 15:21:52 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:21:52 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:21:52 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherA-server-960484498</nova:name>
Oct 23 15:21:52 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:21:52</nova:creationTime>
Oct 23 15:21:52 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:21:52 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:21:52 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:21:52 user nova-compute[74421]:       <nova:owner>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:user uuid="182146bec4cf473ab9e025bca5a74371">tempest-ServerActionsTestOtherA-369604222-project-member</nova:user>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:project uuid="d0053dc54a1e44f18966d687a2bb42e4">tempest-ServerActionsTestOtherA-369604222</nova:project>
Oct 23 15:21:52 user nova-compute[74421]:       </nova:owner>
Oct 23 15:21:52 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:21:52 user nova-compute[74421]:       <nova:ports>
Oct 23 15:21:52 user nova-compute[74421]:         <nova:port uuid="4601ea46-2069-471a-8de8-0547b9aea8c9">
Oct 23 15:21:52 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 15:21:52 user nova-compute[74421]:         </nova:port>
Oct 23 15:21:52 user nova-compute[74421]:       </nova:ports>
Oct 23 15:21:52 user nova-compute[74421]:     </nova:instance>
Oct 23 15:21:52 user nova-compute[74421]:   </metadata>
Oct 23 15:21:52 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:21:52 user nova-compute[74421]:     <system>
Oct 23 15:21:52 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:21:52 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:21:52 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:21:52 user nova-compute[74421]:       <entry name="serial">797f85e1-87ce-4295-8e14-19fd0919f2a0</entry>
Oct 23 15:21:52 user nova-compute[74421]:       <entry name="uuid">797f85e1-87ce-4295-8e14-19fd0919f2a0</entry>
Oct 23 15:21:52 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:21:52 user nova-compute[74421]:     </system>
Oct 23 15:21:52 user nova-compute[74421]:   </sysinfo>
Oct 23 15:21:52 user nova-compute[74421]:   <os>
Oct 23 15:21:52 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:21:52 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:21:52 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:21:52 user nova-compute[74421]:   </os>
Oct 23 15:21:52 user nova-compute[74421]:   <features>
Oct 23 15:21:52 user nova-compute[74421]:     <acpi/>
Oct 23 15:21:52 user nova-compute[74421]:     <apic/>
Oct 23 15:21:52 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:21:52 user nova-compute[74421]:   </features>
Oct 23 15:21:52 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:21:52 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:21:52 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:21:52 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:21:52 user nova-compute[74421]:   </clock>
Oct 23 15:21:52 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:21:52 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:21:52 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:21:52 user nova-compute[74421]:   </cpu>
Oct 23 15:21:52 user nova-compute[74421]:   <devices>
Oct 23 15:21:52 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:21:52 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:21:52 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk"/>
Oct 23 15:21:52 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:21:52 user nova-compute[74421]:     </disk>
Oct 23 15:21:52 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:21:52 user nova-compute[74421]:       <mac address="fa:16:3e:c7:63:28"/>
Oct 23 15:21:52 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:52 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:21:52 user nova-compute[74421]:       <target dev="tap4601ea46-20"/>
Oct 23 15:21:52 user nova-compute[74421]:     </interface>
Oct 23 15:21:52 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:21:52 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/console.log" append="off"/>
Oct 23 15:21:52 user nova-compute[74421]:     </serial>
Oct 23 15:21:52 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:21:52 user nova-compute[74421]:     <video>
Oct 23 15:21:52 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:52 user nova-compute[74421]:     </video>
Oct 23 15:21:52 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:21:52 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:21:52 user nova-compute[74421]:     </rng>
Oct 23 15:21:52 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:21:52 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:21:52 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:21:52 user nova-compute[74421]:     </memballoon>
Oct 23 15:21:52 user nova-compute[74421]:   </devices>
Oct 23 15:21:52 user nova-compute[74421]: </domain>
Oct 23 15:21:52 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-960484498',display_name='tempest-ServerActionsTestOtherA-server-960484498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-960484498',id=4,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-24pj4n4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=797f85e1-87ce-4295-8e14-19fd0919f2a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG os_vif [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afd4bcf6-0ebd-59b9-8e24-08d8416ede7d', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4601ea46-20, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4601ea46-20, col_values=(('qos', UUID('215b0a8c-691c-43ea-a497-44444cdc22f4')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4601ea46-20, col_values=(('external_ids', {'iface-id': '4601ea46-2069-471a-8de8-0547b9aea8c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:63:28', 'vm-uuid': '797f85e1-87ce-4295-8e14-19fd0919f2a0'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:52 user nova-compute[74421]: INFO os_vif [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20')
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No VIF found with MAC fa:16:3e:c7:63:28, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Successfully updated port: 1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquired lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-changed-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Refreshing instance network info cache due to event network-changed-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:21:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] Acquiring lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Successfully updated port: 71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updated VIF entry in instance network info cache for port 4601ea46-2069-471a-8de8-0547b9aea8c9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ee96a9a-9cef-4fd7-86f3-e46d9fa31066 req-2f924146-6013-4445-9ba4-5dcf7913728f service nova] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-changed-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Refreshing instance network info cache due to event network-changed-71eb1292-b5d9-4620-b019-b3cf279774aa. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:21:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] Acquiring lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updating instance_info_cache with network_info: [{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Instance network_info: |[{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] Acquired lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Refreshing network info cache for port 71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Start _get_guest_xml network_info=[{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Successfully updated port: 84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:21:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-867422842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-867422842',id=5,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-r0q4azsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:48Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=83da5c9e-eac9-4f74-9c0c-b003b475415a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.objects.instance [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'pci_devices' on Instance uuid 83da5c9e-eac9-4f74-9c0c-b003b475415a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquired lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:21:54 user nova-compute[74421]:   <uuid>83da5c9e-eac9-4f74-9c0c-b003b475415a</uuid>
Oct 23 15:21:54 user nova-compute[74421]:   <name>instance-00000005</name>
Oct 23 15:21:54 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:21:54 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:21:54 user nova-compute[74421]:   <metadata>
Oct 23 15:21:54 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:21:54 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-867422842</nova:name>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:21:54</nova:creationTime>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:21:54 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:21:54 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:owner>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:user uuid="166776dcccda43409673d99af45d4390">tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member</nova:user>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:project uuid="f733f39c7c95492abc827bd581ca7afa">tempest-ServerBootFromVolumeStableRescueTest-2014752681</nova:project>
Oct 23 15:21:54 user nova-compute[74421]:       </nova:owner>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:ports>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:port uuid="71eb1292-b5d9-4620-b019-b3cf279774aa">
Oct 23 15:21:54 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 15:21:54 user nova-compute[74421]:         </nova:port>
Oct 23 15:21:54 user nova-compute[74421]:       </nova:ports>
Oct 23 15:21:54 user nova-compute[74421]:     </nova:instance>
Oct 23 15:21:54 user nova-compute[74421]:   </metadata>
Oct 23 15:21:54 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:21:54 user nova-compute[74421]:     <system>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="serial">83da5c9e-eac9-4f74-9c0c-b003b475415a</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="uuid">83da5c9e-eac9-4f74-9c0c-b003b475415a</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:21:54 user nova-compute[74421]:     </system>
Oct 23 15:21:54 user nova-compute[74421]:   </sysinfo>
Oct 23 15:21:54 user nova-compute[74421]:   <os>
Oct 23 15:21:54 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:21:54 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:21:54 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:21:54 user nova-compute[74421]:   </os>
Oct 23 15:21:54 user nova-compute[74421]:   <features>
Oct 23 15:21:54 user nova-compute[74421]:     <acpi/>
Oct 23 15:21:54 user nova-compute[74421]:     <apic/>
Oct 23 15:21:54 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:21:54 user nova-compute[74421]:   </features>
Oct 23 15:21:54 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:21:54 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:21:54 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:21:54 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:21:54 user nova-compute[74421]:   </clock>
Oct 23 15:21:54 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:21:54 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:21:54 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:21:54 user nova-compute[74421]:   </cpu>
Oct 23 15:21:54 user nova-compute[74421]:   <devices>
Oct 23 15:21:54 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:21:54 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:21:54 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk"/>
Oct 23 15:21:54 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:21:54 user nova-compute[74421]:     </disk>
Oct 23 15:21:54 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:21:54 user nova-compute[74421]:       <mac address="fa:16:3e:2a:e5:f7"/>
Oct 23 15:21:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:54 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:21:54 user nova-compute[74421]:       <target dev="tap71eb1292-b5"/>
Oct 23 15:21:54 user nova-compute[74421]:     </interface>
Oct 23 15:21:54 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:21:54 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/console.log" append="off"/>
Oct 23 15:21:54 user nova-compute[74421]:     </serial>
Oct 23 15:21:54 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:21:54 user nova-compute[74421]:     <video>
Oct 23 15:21:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:54 user nova-compute[74421]:     </video>
Oct 23 15:21:54 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:21:54 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:21:54 user nova-compute[74421]:     </rng>
Oct 23 15:21:54 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:21:54 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:21:54 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:21:54 user nova-compute[74421]:     </memballoon>
Oct 23 15:21:54 user nova-compute[74421]:   </devices>
Oct 23 15:21:54 user nova-compute[74421]: </domain>
Oct 23 15:21:54 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-867422842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-867422842',id=5,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-r0q4azsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:48Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=83da5c9e-eac9-4f74-9c0c-b003b475415a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG os_vif [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19b6b956-a4c7-5cd3-b6bc-a52f5e20aab9', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71eb1292-b5, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71eb1292-b5, col_values=(('qos', UUID('4fc615af-cbfc-4dc6-94b4-ecf40b9419bb')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71eb1292-b5, col_values=(('external_ids', {'iface-id': '71eb1292-b5d9-4620-b019-b3cf279774aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:e5:f7', 'vm-uuid': '83da5c9e-eac9-4f74-9c0c-b003b475415a'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: INFO os_vif [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5')
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No VIF found with MAC fa:16:3e:2a:e5:f7, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updating instance_info_cache with network_info: [{"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Releasing lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Instance network_info: |[{"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] Acquired lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Refreshing network info cache for port 1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Start _get_guest_xml network_info=[{"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:21:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1368490471',display_name='tempest-DeleteServersTestJSON-server-1368490471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1368490471',id=2,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6cc6b03c90249999ab8c6f3eb605c4a',ramdisk_id='',reservation_id='r-occh805a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1403186658',owner_user_name='tempest-DeleteServersTestJSON-1403186658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:46Z,user_data=None,user_id='b4cdf16d4f324a4dba27657c6c6d4a5c',uuid=d1c23a9b-3859-4413-b85a-05dbb575f29b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Converting VIF {"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.objects.instance [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c23a9b-3859-4413-b85a-05dbb575f29b {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:21:54 user nova-compute[74421]:   <uuid>d1c23a9b-3859-4413-b85a-05dbb575f29b</uuid>
Oct 23 15:21:54 user nova-compute[74421]:   <name>instance-00000002</name>
Oct 23 15:21:54 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:21:54 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:21:54 user nova-compute[74421]:   <metadata>
Oct 23 15:21:54 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:21:54 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:name>tempest-DeleteServersTestJSON-server-1368490471</nova:name>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:21:54</nova:creationTime>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:21:54 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:21:54 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:owner>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:user uuid="b4cdf16d4f324a4dba27657c6c6d4a5c">tempest-DeleteServersTestJSON-1403186658-project-member</nova:user>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:project uuid="a6cc6b03c90249999ab8c6f3eb605c4a">tempest-DeleteServersTestJSON-1403186658</nova:project>
Oct 23 15:21:54 user nova-compute[74421]:       </nova:owner>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:21:54 user nova-compute[74421]:       <nova:ports>
Oct 23 15:21:54 user nova-compute[74421]:         <nova:port uuid="1ad16d5a-21ec-4c93-ac44-4dcef9c373fc">
Oct 23 15:21:54 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 15:21:54 user nova-compute[74421]:         </nova:port>
Oct 23 15:21:54 user nova-compute[74421]:       </nova:ports>
Oct 23 15:21:54 user nova-compute[74421]:     </nova:instance>
Oct 23 15:21:54 user nova-compute[74421]:   </metadata>
Oct 23 15:21:54 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:21:54 user nova-compute[74421]:     <system>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="serial">d1c23a9b-3859-4413-b85a-05dbb575f29b</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="uuid">d1c23a9b-3859-4413-b85a-05dbb575f29b</entry>
Oct 23 15:21:54 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:21:54 user nova-compute[74421]:     </system>
Oct 23 15:21:54 user nova-compute[74421]:   </sysinfo>
Oct 23 15:21:54 user nova-compute[74421]:   <os>
Oct 23 15:21:54 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:21:54 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:21:54 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:21:54 user nova-compute[74421]:   </os>
Oct 23 15:21:54 user nova-compute[74421]:   <features>
Oct 23 15:21:54 user nova-compute[74421]:     <acpi/>
Oct 23 15:21:54 user nova-compute[74421]:     <apic/>
Oct 23 15:21:54 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:21:54 user nova-compute[74421]:   </features>
Oct 23 15:21:54 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:21:54 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:21:54 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:21:54 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:21:54 user nova-compute[74421]:   </clock>
Oct 23 15:21:54 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:21:54 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:21:54 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:21:54 user nova-compute[74421]:   </cpu>
Oct 23 15:21:54 user nova-compute[74421]:   <devices>
Oct 23 15:21:54 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:21:54 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:21:54 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk"/>
Oct 23 15:21:54 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:21:54 user nova-compute[74421]:     </disk>
Oct 23 15:21:54 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:21:54 user nova-compute[74421]:       <mac address="fa:16:3e:fa:47:b4"/>
Oct 23 15:21:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:54 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:21:54 user nova-compute[74421]:       <target dev="tap1ad16d5a-21"/>
Oct 23 15:21:54 user nova-compute[74421]:     </interface>
Oct 23 15:21:54 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:21:54 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/console.log" append="off"/>
Oct 23 15:21:54 user nova-compute[74421]:     </serial>
Oct 23 15:21:54 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:21:54 user nova-compute[74421]:     <video>
Oct 23 15:21:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:54 user nova-compute[74421]:     </video>
Oct 23 15:21:54 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:21:54 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:21:54 user nova-compute[74421]:     </rng>
Oct 23 15:21:54 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:21:54 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:21:54 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:21:54 user nova-compute[74421]:     </memballoon>
Oct 23 15:21:54 user nova-compute[74421]:   </devices>
Oct 23 15:21:54 user nova-compute[74421]: </domain>
Oct 23 15:21:54 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1368490471',display_name='tempest-DeleteServersTestJSON-server-1368490471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1368490471',id=2,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6cc6b03c90249999ab8c6f3eb605c4a',ramdisk_id='',reservation_id='r-occh805a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1403186658',owner_user_name='tempest-DeleteServersTestJSON-1403186658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:46Z,user_data=None,user_id='b4cdf16d4f324a4dba27657c6c6d4a5c',uuid=d1c23a9b-3859-4413-b85a-05dbb575f29b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Converting VIF {"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG os_vif [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bb2974b-827b-5f46-bd9a-c5dcf1ddd648', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad16d5a-21, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ad16d5a-21, col_values=(('qos', UUID('3a578646-63b0-4780-9251-4bcd894583b8')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ad16d5a-21, col_values=(('external_ids', {'iface-id': '1ad16d5a-21ec-4c93-ac44-4dcef9c373fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:47:b4', 'vm-uuid': 'd1c23a9b-3859-4413-b85a-05dbb575f29b'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: INFO os_vif [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21')
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] No VIF found with MAC fa:16:3e:fa:47:b4, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-changed-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Refreshing instance network info cache due to event network-changed-84cc0fa9-3418-448b-9c04-36388db48a87. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] Acquiring lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.network.neutron [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updated VIF entry in instance network info cache for port 71eb1292-b5d9-4620-b019-b3cf279774aa. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.network.neutron [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updating instance_info_cache with network_info: [{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a86d8744-eb0a-404a-a609-27b5aaf7202d req-ce74e0cf-8ca6-46c3-b1c5-01fdfbfa9c7c service nova] Releasing lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Successfully updated port: 7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:21:55 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updating instance_info_cache with network_info: [{"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Releasing lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Instance network_info: |[{"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] Acquired lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.neutron [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Refreshing network info cache for port 84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Start _get_guest_xml network_info=[{"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:21:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1596576925',display_name='tempest-AttachVolumeNegativeTest-server-1596576925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1596576925',id=3,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhsAvJYNEuXrOKDk3axq6msspiCsjU0Sx5X/zA5Vz3szLZawti2YtjatWg2hNr427VOSbLZlZmfd4cq90FhUFpJr1NWo/1kjpgaRLBQX/nvtYxwX9SgqekgFnX8eTHttQ==',key_name='tempest-keypair-1201945346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-jhhz10f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=95dc4c72-5e91-4666-a31b-037e690c0e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.objects.instance [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'pci_devices' on Instance uuid 95dc4c72-5e91-4666-a31b-037e690c0e6d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:21:56 user nova-compute[74421]:   <uuid>95dc4c72-5e91-4666-a31b-037e690c0e6d</uuid>
Oct 23 15:21:56 user nova-compute[74421]:   <name>instance-00000003</name>
Oct 23 15:21:56 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:21:56 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:21:56 user nova-compute[74421]:   <metadata>
Oct 23 15:21:56 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:21:56 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1596576925</nova:name>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:21:56</nova:creationTime>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:21:56 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:21:56 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:owner>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:user uuid="1e711d55fe644a0ca518fa34d187b79f">tempest-AttachVolumeNegativeTest-100322526-project-member</nova:user>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:project uuid="74e90bcb97e74feaa5e6247b7fc0d3f2">tempest-AttachVolumeNegativeTest-100322526</nova:project>
Oct 23 15:21:56 user nova-compute[74421]:       </nova:owner>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:ports>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:port uuid="84cc0fa9-3418-448b-9c04-36388db48a87">
Oct 23 15:21:56 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:21:56 user nova-compute[74421]:         </nova:port>
Oct 23 15:21:56 user nova-compute[74421]:       </nova:ports>
Oct 23 15:21:56 user nova-compute[74421]:     </nova:instance>
Oct 23 15:21:56 user nova-compute[74421]:   </metadata>
Oct 23 15:21:56 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:21:56 user nova-compute[74421]:     <system>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="serial">95dc4c72-5e91-4666-a31b-037e690c0e6d</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="uuid">95dc4c72-5e91-4666-a31b-037e690c0e6d</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:21:56 user nova-compute[74421]:     </system>
Oct 23 15:21:56 user nova-compute[74421]:   </sysinfo>
Oct 23 15:21:56 user nova-compute[74421]:   <os>
Oct 23 15:21:56 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:21:56 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:21:56 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:21:56 user nova-compute[74421]:   </os>
Oct 23 15:21:56 user nova-compute[74421]:   <features>
Oct 23 15:21:56 user nova-compute[74421]:     <acpi/>
Oct 23 15:21:56 user nova-compute[74421]:     <apic/>
Oct 23 15:21:56 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:21:56 user nova-compute[74421]:   </features>
Oct 23 15:21:56 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:21:56 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:21:56 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:21:56 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:21:56 user nova-compute[74421]:   </clock>
Oct 23 15:21:56 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:21:56 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:21:56 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:21:56 user nova-compute[74421]:   </cpu>
Oct 23 15:21:56 user nova-compute[74421]:   <devices>
Oct 23 15:21:56 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:21:56 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:21:56 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk"/>
Oct 23 15:21:56 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:21:56 user nova-compute[74421]:     </disk>
Oct 23 15:21:56 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:21:56 user nova-compute[74421]:       <mac address="fa:16:3e:29:d4:84"/>
Oct 23 15:21:56 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:56 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:21:56 user nova-compute[74421]:       <target dev="tap84cc0fa9-34"/>
Oct 23 15:21:56 user nova-compute[74421]:     </interface>
Oct 23 15:21:56 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:21:56 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/console.log" append="off"/>
Oct 23 15:21:56 user nova-compute[74421]:     </serial>
Oct 23 15:21:56 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:21:56 user nova-compute[74421]:     <video>
Oct 23 15:21:56 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:56 user nova-compute[74421]:     </video>
Oct 23 15:21:56 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:21:56 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:21:56 user nova-compute[74421]:     </rng>
Oct 23 15:21:56 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:21:56 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:21:56 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:21:56 user nova-compute[74421]:     </memballoon>
Oct 23 15:21:56 user nova-compute[74421]:   </devices>
Oct 23 15:21:56 user nova-compute[74421]: </domain>
Oct 23 15:21:56 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1596576925',display_name='tempest-AttachVolumeNegativeTest-server-1596576925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1596576925',id=3,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhsAvJYNEuXrOKDk3axq6msspiCsjU0Sx5X/zA5Vz3szLZawti2YtjatWg2hNr427VOSbLZlZmfd4cq90FhUFpJr1NWo/1kjpgaRLBQX/nvtYxwX9SgqekgFnX8eTHttQ==',key_name='tempest-keypair-1201945346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-jhhz10f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=95dc4c72-5e91-4666-a31b-037e690c0e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG os_vif [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86966ef9-90c3-5fa8-91ae-6d6de9f46e78', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84cc0fa9-34, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84cc0fa9-34, col_values=(('qos', UUID('1547bb2f-efe6-44d1-a367-3ceb0f8ae699')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84cc0fa9-34, col_values=(('external_ids', {'iface-id': '84cc0fa9-3418-448b-9c04-36388db48a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:d4:84', 'vm-uuid': '95dc4c72-5e91-4666-a31b-037e690c0e6d'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: INFO os_vif [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34')
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:29:d4:84, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.neutron [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updated VIF entry in instance network info cache for port 1ad16d5a-21ec-4c93-ac44-4dcef9c373fc. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.neutron [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updating instance_info_cache with network_info: [{"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d3887eb6-6032-46b6-8716-3e7118b414a5 req-974addd8-ce7f-4b0c-aca7-dadb403ba13d service nova] Releasing lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance network_info: |[{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start _get_guest_xml network_info=[{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:21:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.objects.instance [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'pci_devices' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:21:56 user nova-compute[74421]:   <uuid>ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</uuid>
Oct 23 15:21:56 user nova-compute[74421]:   <name>instance-00000006</name>
Oct 23 15:21:56 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:21:56 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:21:56 user nova-compute[74421]:   <metadata>
Oct 23 15:21:56 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:21:56 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherB-server-652792039</nova:name>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:21:56</nova:creationTime>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:21:56 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:21:56 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:owner>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:user uuid="ce501ef5d45c43efa6fd1329bd1b417d">tempest-ServerActionsTestOtherB-919492088-project-member</nova:user>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:project uuid="6fd7efc2de094cc6b45ebe7e14aceecb">tempest-ServerActionsTestOtherB-919492088</nova:project>
Oct 23 15:21:56 user nova-compute[74421]:       </nova:owner>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:21:56 user nova-compute[74421]:       <nova:ports>
Oct 23 15:21:56 user nova-compute[74421]:         <nova:port uuid="7dd217a3-a501-4e28-a7f6-659356f41eca">
Oct 23 15:21:56 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:21:56 user nova-compute[74421]:         </nova:port>
Oct 23 15:21:56 user nova-compute[74421]:       </nova:ports>
Oct 23 15:21:56 user nova-compute[74421]:     </nova:instance>
Oct 23 15:21:56 user nova-compute[74421]:   </metadata>
Oct 23 15:21:56 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:21:56 user nova-compute[74421]:     <system>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="serial">ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="uuid">ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</entry>
Oct 23 15:21:56 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:21:56 user nova-compute[74421]:     </system>
Oct 23 15:21:56 user nova-compute[74421]:   </sysinfo>
Oct 23 15:21:56 user nova-compute[74421]:   <os>
Oct 23 15:21:56 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:21:56 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:21:56 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:21:56 user nova-compute[74421]:   </os>
Oct 23 15:21:56 user nova-compute[74421]:   <features>
Oct 23 15:21:56 user nova-compute[74421]:     <acpi/>
Oct 23 15:21:56 user nova-compute[74421]:     <apic/>
Oct 23 15:21:56 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:21:56 user nova-compute[74421]:   </features>
Oct 23 15:21:56 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:21:56 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:21:56 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:21:56 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:21:56 user nova-compute[74421]:   </clock>
Oct 23 15:21:56 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:21:56 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:21:56 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:21:56 user nova-compute[74421]:   </cpu>
Oct 23 15:21:56 user nova-compute[74421]:   <devices>
Oct 23 15:21:56 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:21:56 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:21:56 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk"/>
Oct 23 15:21:56 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:21:56 user nova-compute[74421]:     </disk>
Oct 23 15:21:56 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:21:56 user nova-compute[74421]:       <mac address="fa:16:3e:c9:79:7e"/>
Oct 23 15:21:56 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:56 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:21:56 user nova-compute[74421]:       <target dev="tap7dd217a3-a5"/>
Oct 23 15:21:56 user nova-compute[74421]:     </interface>
Oct 23 15:21:56 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:21:56 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/console.log" append="off"/>
Oct 23 15:21:56 user nova-compute[74421]:     </serial>
Oct 23 15:21:56 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:21:56 user nova-compute[74421]:     <video>
Oct 23 15:21:56 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:21:56 user nova-compute[74421]:     </video>
Oct 23 15:21:56 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:21:56 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:21:56 user nova-compute[74421]:     </rng>
Oct 23 15:21:56 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:21:56 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:21:56 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:21:56 user nova-compute[74421]:     </memballoon>
Oct 23 15:21:56 user nova-compute[74421]:   </devices>
Oct 23 15:21:56 user nova-compute[74421]: </domain>
Oct 23 15:21:56 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG os_vif [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74c9b4e8-b78a-5087-967b-49bf23df1c4c', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dd217a3-a5, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dd217a3-a5, col_values=(('qos', UUID('72ebf703-7212-4a21-8a3f-bfbe78963ca4')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dd217a3-a5, col_values=(('external_ids', {'iface-id': '7dd217a3-a501-4e28-a7f6-659356f41eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:79:7e', 'vm-uuid': 'ee5687a0-6e1a-4ce6-954a-d6959b2c8c12'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: INFO os_vif [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5')
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No VIF found with MAC fa:16:3e:c9:79:7e, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-changed-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Refreshing instance network info cache due to event network-changed-7dd217a3-a501-4e28-a7f6-659356f41eca. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.network.neutron [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Refreshing network info cache for port 7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.network.neutron [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updated VIF entry in instance network info cache for port 84cc0fa9-3418-448b-9c04-36388db48a87. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG nova.network.neutron [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updating instance_info_cache with network_info: [{"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-316bbf83-40ec-4e52-a015-efa5f7314e2a req-2fc16e9a-c230-43c4-a48a-216465c43ef5 service nova] Releasing lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updated VIF entry in instance network info cache for port 7dd217a3-a501-4e28-a7f6-659356f41eca. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-454c66a7-932f-42a9-a96b-9aa8bbf638cf req-942276c3-3442-472e-a30a-796b632fdc3c service nova] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:21:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:21:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Instance spawned successfully.
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:01 user nova-compute[74421]: INFO nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Took 13.97 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:01 user nova-compute[74421]: INFO nova.compute.manager [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Took 15.54 seconds to build instance.
Oct 23 15:22:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2568a413-e3e6-4f32-bb2a-e3a782dcdf4f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.729s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-318c4462-b5ca-48ae-853e-6f4f11416a60 req-cba98ebc-2f24-4eb5-9c6b-d65c55559b9e service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-318c4462-b5ca-48ae-853e-6f4f11416a60 req-cba98ebc-2f24-4eb5-9c6b-d65c55559b9e service nova] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-318c4462-b5ca-48ae-853e-6f4f11416a60 req-cba98ebc-2f24-4eb5-9c6b-d65c55559b9e service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-318c4462-b5ca-48ae-853e-6f4f11416a60 req-cba98ebc-2f24-4eb5-9c6b-d65c55559b9e service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-318c4462-b5ca-48ae-853e-6f4f11416a60 req-cba98ebc-2f24-4eb5-9c6b-d65c55559b9e service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] No waiting events found dispatching network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:02 user nova-compute[74421]: WARNING nova.compute.manager [req-318c4462-b5ca-48ae-853e-6f4f11416a60 req-cba98ebc-2f24-4eb5-9c6b-d65c55559b9e service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received unexpected event network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 for instance with vm_state building and task_state spawning.
Oct 23 15:22:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:03 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Instance spawned successfully.
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: INFO nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Took 15.34 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:03 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Instance spawned successfully.
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: INFO nova.compute.manager [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Took 17.38 seconds to build instance.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3148dcee-301b-4365-97fe-a62c4104da2a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.516s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:04 user nova-compute[74421]: INFO nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Took 17.73 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Instance spawned successfully.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:04 user nova-compute[74421]: INFO nova.compute.manager [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Took 19.43 seconds to build instance.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-97091a1d-fd6d-449b-8fe5-94c21c98e0b7 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.627s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:04 user nova-compute[74421]: INFO nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Took 18.52 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] No waiting events found dispatching network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:04 user nova-compute[74421]: WARNING nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received unexpected event network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 for instance with vm_state active and task_state None.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:04 user nova-compute[74421]: WARNING nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state building and task_state spawning.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:04 user nova-compute[74421]: WARNING nova.compute.manager [req-8f807444-f1c1-4a7d-8325-0e8083b2c94b req-b5955829-7fed-4444-89a4-a3bb3f3c0142 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state building and task_state spawning.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:04 user nova-compute[74421]: INFO nova.compute.manager [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Took 19.78 seconds to build instance.
Oct 23 15:22:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fddb5700-dea9-41be-8327-78c8434f7580 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.985s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance spawned successfully.
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:05 user nova-compute[74421]: INFO nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Took 17.43 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:05 user nova-compute[74421]: INFO nova.compute.manager [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Took 18.69 seconds to build instance.
Oct 23 15:22:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0e5242df-74c5-4277-acfd-ccdc057b11ad tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.890s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-bb97acc9-19eb-477a-912d-6f6eedca5e2c req-7fa748db-b3a4-4d9e-8116-7f8a818970ec service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bb97acc9-19eb-477a-912d-6f6eedca5e2c req-7fa748db-b3a4-4d9e-8116-7f8a818970ec service nova] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bb97acc9-19eb-477a-912d-6f6eedca5e2c req-7fa748db-b3a4-4d9e-8116-7f8a818970ec service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bb97acc9-19eb-477a-912d-6f6eedca5e2c req-7fa748db-b3a4-4d9e-8116-7f8a818970ec service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-bb97acc9-19eb-477a-912d-6f6eedca5e2c req-7fa748db-b3a4-4d9e-8116-7f8a818970ec service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] No waiting events found dispatching network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:05 user nova-compute[74421]: WARNING nova.compute.manager [req-bb97acc9-19eb-477a-912d-6f6eedca5e2c req-7fa748db-b3a4-4d9e-8116-7f8a818970ec service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received unexpected event network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 for instance with vm_state active and task_state None.
Oct 23 15:22:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:22:07 user nova-compute[74421]: INFO nova.compute.claims [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Claim successful on node user
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] No waiting events found dispatching network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:07 user nova-compute[74421]: WARNING nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received unexpected event network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 for instance with vm_state active and task_state None.
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] No waiting events found dispatching network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:07 user nova-compute[74421]: WARNING nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received unexpected event network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 for instance with vm_state active and task_state None.
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] No waiting events found dispatching network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:07 user nova-compute[74421]: WARNING nova.compute.manager [req-0fafdd61-c1d5-4deb-aaae-0982b3f1e76d req-7a5ec48d-791c-4310-9b3a-7dd2967f76bd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received unexpected event network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 for instance with vm_state active and task_state None.
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:22:07 user nova-compute[74421]: DEBUG nova.network.neutron [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:22:07 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 23 15:22:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG nova.policy [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70ba86d480f7479d9ce288aca1b1e622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8111551b98454fbc3cc17bfe05b8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:22:08 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Creating image(s)
Oct 23 15:22:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "/opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "/opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "/opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "2ea74bb1c537ec6321bd876b8b3f9d219e83012e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "2ea74bb1c537ec6321bd876b8b3f9d219e83012e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.part --force-share --output=json" returned: 0 in 0.280s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG nova.virt.images [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] 1a466289-1768-42e4-8de0-4af670c90069 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.part /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.part /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.converted" returned: 0 in 0.309s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e.converted --force-share --output=json" returned: 0 in 0.290s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "2ea74bb1c537ec6321bd876b8b3f9d219e83012e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.682s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e --force-share --output=json" returned: 0 in 0.305s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "2ea74bb1c537ec6321bd876b8b3f9d219e83012e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "2ea74bb1c537ec6321bd876b8b3f9d219e83012e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG nova.network.neutron [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Successfully created port: 9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e --force-share --output=json" returned: 0 in 0.244s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e,backing_fmt=raw /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e,backing_fmt=raw /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk 1073741824" returned: 0 in 0.071s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "2ea74bb1c537ec6321bd876b8b3f9d219e83012e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e --force-share --output=json" returned: 0 in 0.347s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:22:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Cannot resize image /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Ensure instance console log exists: /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Successfully updated port: 9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquired lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-changed-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Refreshing instance network info cache due to event network-changed-9fecdec2-d2d3-4248-8541-4b96c3b1409a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] Acquiring lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updating instance_info_cache with network_info: [{"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Releasing lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Instance network_info: |[{"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] Acquired lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.network.neutron [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Refreshing network info cache for port 9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Start _get_guest_xml network_info=[{"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:21:58Z,direct_url=<?>,disk_format='qcow2',id=1a466289-1768-42e4-8de0-4af670c90069,min_disk=0,min_ram=0,name='',owner='5fb0f63c8567487790ef235b1d4074b7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:22:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'image_id': '1a466289-1768-42e4-8de0-4af670c90069'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:22:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:21:58Z,direct_url=<?>,disk_format='qcow2',id=1a466289-1768-42e4-8de0-4af670c90069,min_disk=0,min_ram=0,name='',owner='5fb0f63c8567487790ef235b1d4074b7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:22:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1955657409',display_name='tempest-AttachSCSIVolumeTestJSON-server-1955657409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1955657409',id=7,image_ref='1a466289-1768-42e4-8de0-4af670c90069',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdW8r6nbeDNMviTUGyHJgjndFyUiwtayVMah2c5mZPndAgL5SMqoWYIx3oU+00WbM8XMl3MdjBIamkWnmoAnh0zw2+B1sk7TmaeuZc6RuVIsvJTk0Mwd6I8tYZxfzJ/1g==',key_name='tempest-keypair-1896426116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8111551b98454fbc3cc17bfe05b8f0',ramdisk_id='',reservation_id='r-c84spzdv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a466289-1768-42e4-8de0-4af670c90069',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-313192039',owner_user_name='tempest-AttachSCSIVolumeTestJSON-313192039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70ba86d480f7479d9ce288aca1b1e622',uuid=e28652be-528a-454c-a4d1-2f35474f271a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Converting VIF {"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.objects.instance [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lazy-loading 'pci_devices' on Instance uuid e28652be-528a-454c-a4d1-2f35474f271a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:22:12 user nova-compute[74421]:   <uuid>e28652be-528a-454c-a4d1-2f35474f271a</uuid>
Oct 23 15:22:12 user nova-compute[74421]:   <name>instance-00000007</name>
Oct 23 15:22:12 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:22:12 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:22:12 user nova-compute[74421]:   <metadata>
Oct 23 15:22:12 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:22:12 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:22:12 user nova-compute[74421]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1955657409</nova:name>
Oct 23 15:22:12 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:22:12</nova:creationTime>
Oct 23 15:22:12 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:22:12 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:22:12 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:22:12 user nova-compute[74421]:       <nova:owner>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:user uuid="70ba86d480f7479d9ce288aca1b1e622">tempest-AttachSCSIVolumeTestJSON-313192039-project-member</nova:user>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:project uuid="8b8111551b98454fbc3cc17bfe05b8f0">tempest-AttachSCSIVolumeTestJSON-313192039</nova:project>
Oct 23 15:22:12 user nova-compute[74421]:       </nova:owner>
Oct 23 15:22:12 user nova-compute[74421]:       <nova:root type="image" uuid="1a466289-1768-42e4-8de0-4af670c90069"/>
Oct 23 15:22:12 user nova-compute[74421]:       <nova:ports>
Oct 23 15:22:12 user nova-compute[74421]:         <nova:port uuid="9fecdec2-d2d3-4248-8541-4b96c3b1409a">
Oct 23 15:22:12 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 15:22:12 user nova-compute[74421]:         </nova:port>
Oct 23 15:22:12 user nova-compute[74421]:       </nova:ports>
Oct 23 15:22:12 user nova-compute[74421]:     </nova:instance>
Oct 23 15:22:12 user nova-compute[74421]:   </metadata>
Oct 23 15:22:12 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:22:12 user nova-compute[74421]:     <system>
Oct 23 15:22:12 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:22:12 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:22:12 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:22:12 user nova-compute[74421]:       <entry name="serial">e28652be-528a-454c-a4d1-2f35474f271a</entry>
Oct 23 15:22:12 user nova-compute[74421]:       <entry name="uuid">e28652be-528a-454c-a4d1-2f35474f271a</entry>
Oct 23 15:22:12 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:22:12 user nova-compute[74421]:     </system>
Oct 23 15:22:12 user nova-compute[74421]:   </sysinfo>
Oct 23 15:22:12 user nova-compute[74421]:   <os>
Oct 23 15:22:12 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:22:12 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:22:12 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:22:12 user nova-compute[74421]:   </os>
Oct 23 15:22:12 user nova-compute[74421]:   <features>
Oct 23 15:22:12 user nova-compute[74421]:     <acpi/>
Oct 23 15:22:12 user nova-compute[74421]:     <apic/>
Oct 23 15:22:12 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:22:12 user nova-compute[74421]:   </features>
Oct 23 15:22:12 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:22:12 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:22:12 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:22:12 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:22:12 user nova-compute[74421]:   </clock>
Oct 23 15:22:12 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:22:12 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:22:12 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:22:12 user nova-compute[74421]:   </cpu>
Oct 23 15:22:12 user nova-compute[74421]:   <devices>
Oct 23 15:22:12 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:22:12 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:22:12 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk"/>
Oct 23 15:22:12 user nova-compute[74421]:       <target dev="sda" bus="scsi"/>
Oct 23 15:22:12 user nova-compute[74421]:       <address type="drive" controller="0" unit="0"/>
Oct 23 15:22:12 user nova-compute[74421]:     </disk>
Oct 23 15:22:12 user nova-compute[74421]:     <disk type="file" device="cdrom">
Oct 23 15:22:12 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 15:22:12 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.config"/>
Oct 23 15:22:12 user nova-compute[74421]:       <target dev="sdb" bus="scsi"/>
Oct 23 15:22:12 user nova-compute[74421]:       <address type="drive" controller="0" unit="1"/>
Oct 23 15:22:12 user nova-compute[74421]:     </disk>
Oct 23 15:22:12 user nova-compute[74421]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 23 15:22:12 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:22:12 user nova-compute[74421]:       <mac address="fa:16:3e:c0:70:51"/>
Oct 23 15:22:12 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:22:12 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:22:12 user nova-compute[74421]:       <target dev="tap9fecdec2-d2"/>
Oct 23 15:22:12 user nova-compute[74421]:     </interface>
Oct 23 15:22:12 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:22:12 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/console.log" append="off"/>
Oct 23 15:22:12 user nova-compute[74421]:     </serial>
Oct 23 15:22:12 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:22:12 user nova-compute[74421]:     <video>
Oct 23 15:22:12 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:22:12 user nova-compute[74421]:     </video>
Oct 23 15:22:12 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:22:12 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:22:12 user nova-compute[74421]:     </rng>
Oct 23 15:22:12 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:22:12 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:22:12 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:22:12 user nova-compute[74421]:     </memballoon>
Oct 23 15:22:12 user nova-compute[74421]:   </devices>
Oct 23 15:22:12 user nova-compute[74421]: </domain>
Oct 23 15:22:12 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1955657409',display_name='tempest-AttachSCSIVolumeTestJSON-server-1955657409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1955657409',id=7,image_ref='1a466289-1768-42e4-8de0-4af670c90069',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdW8r6nbeDNMviTUGyHJgjndFyUiwtayVMah2c5mZPndAgL5SMqoWYIx3oU+00WbM8XMl3MdjBIamkWnmoAnh0zw2+B1sk7TmaeuZc6RuVIsvJTk0Mwd6I8tYZxfzJ/1g==',key_name='tempest-keypair-1896426116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8111551b98454fbc3cc17bfe05b8f0',ramdisk_id='',reservation_id='r-c84spzdv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a466289-1768-42e4-8de0-4af670c90069',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-313192039',owner_user_name='tempest-AttachSCSIVolumeTestJSON-313192039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70ba86d480f7479d9ce288aca1b1e622',uuid=e28652be-528a-454c-a4d1-2f35474f271a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Converting VIF {"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG os_vif [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00743e20-0570-5924-9443-cbcb47f786d1', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fecdec2-d2, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fecdec2-d2, col_values=(('qos', UUID('3081c926-9787-4729-a1ba-bdbc0de50789')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fecdec2-d2, col_values=(('external_ids', {'iface-id': '9fecdec2-d2d3-4248-8541-4b96c3b1409a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:70:51', 'vm-uuid': 'e28652be-528a-454c-a4d1-2f35474f271a'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:12 user nova-compute[74421]: INFO os_vif [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2')
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No BDM found with device name sda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:22:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No VIF found with MAC fa:16:3e:c0:70:51, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:22:12 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Using config drive
Oct 23 15:22:13 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Creating config drive at /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.config
Oct 23 15:22:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptj9__cgj {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptj9__cgj" returned: 0 in 0.075s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updated VIF entry in instance network info cache for port 9fecdec2-d2d3-4248-8541-4b96c3b1409a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updating instance_info_cache with network_info: [{"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e8ef1bf3-27cd-4cd3-a3b3-3e3ff320102d req-7bef0246-4e55-4ce9-99e2-8c6363be3807 service nova] Releasing lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-f535503f-c550-441f-9396-b8013072da13 req-73b88301-399e-425f-9798-2cdf24f4856b service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f535503f-c550-441f-9396-b8013072da13 req-73b88301-399e-425f-9798-2cdf24f4856b service nova] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f535503f-c550-441f-9396-b8013072da13 req-73b88301-399e-425f-9798-2cdf24f4856b service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f535503f-c550-441f-9396-b8013072da13 req-73b88301-399e-425f-9798-2cdf24f4856b service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-f535503f-c550-441f-9396-b8013072da13 req-73b88301-399e-425f-9798-2cdf24f4856b service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] No waiting events found dispatching network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:13 user nova-compute[74421]: WARNING nova.compute.manager [req-f535503f-c550-441f-9396-b8013072da13 req-73b88301-399e-425f-9798-2cdf24f4856b service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received unexpected event network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa for instance with vm_state active and task_state None.
Oct 23 15:22:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:22:15 user nova-compute[74421]: INFO nova.compute.claims [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Claim successful on node user
Oct 23 15:22:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-2a18ee19-b587-4c90-af97-f88014cc79ff req-1e87b5d8-0a84-42ce-aba2-0dbc40901b87 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2a18ee19-b587-4c90-af97-f88014cc79ff req-1e87b5d8-0a84-42ce-aba2-0dbc40901b87 service nova] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2a18ee19-b587-4c90-af97-f88014cc79ff req-1e87b5d8-0a84-42ce-aba2-0dbc40901b87 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2a18ee19-b587-4c90-af97-f88014cc79ff req-1e87b5d8-0a84-42ce-aba2-0dbc40901b87 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-2a18ee19-b587-4c90-af97-f88014cc79ff req-1e87b5d8-0a84-42ce-aba2-0dbc40901b87 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] No waiting events found dispatching network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:15 user nova-compute[74421]: WARNING nova.compute.manager [req-2a18ee19-b587-4c90-af97-f88014cc79ff req-1e87b5d8-0a84-42ce-aba2-0dbc40901b87 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received unexpected event network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a for instance with vm_state building and task_state spawning.
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-78877be2-7bfe-4cb3-b03a-ebdfe3db8de9 req-947bb81f-7a97-4057-be3a-50b6606ade48 service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-78877be2-7bfe-4cb3-b03a-ebdfe3db8de9 req-947bb81f-7a97-4057-be3a-50b6606ade48 service nova] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-78877be2-7bfe-4cb3-b03a-ebdfe3db8de9 req-947bb81f-7a97-4057-be3a-50b6606ade48 service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-78877be2-7bfe-4cb3-b03a-ebdfe3db8de9 req-947bb81f-7a97-4057-be3a-50b6606ade48 service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-78877be2-7bfe-4cb3-b03a-ebdfe3db8de9 req-947bb81f-7a97-4057-be3a-50b6606ade48 service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] No waiting events found dispatching network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:16 user nova-compute[74421]: WARNING nova.compute.manager [req-78877be2-7bfe-4cb3-b03a-ebdfe3db8de9 req-947bb81f-7a97-4057-be3a-50b6606ade48 service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received unexpected event network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa for instance with vm_state active and task_state None.
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.898s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.network.neutron [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:22:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.policy [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b83377d1f6643c696cce0af08335438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8557c583d6da4580af96f29504437579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:22:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Creating image(s)
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.244s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.245s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk 1073741824" returned: 0 in 0.058s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.242s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG nova.network.neutron [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Successfully created port: 04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Cannot resize image /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Ensure instance console log exists: /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-eed7d057-5099-44a7-bd3c-d07be180dae9 req-65b4ac5e-1e1f-46c3-85fc-655340c8e7f6 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eed7d057-5099-44a7-bd3c-d07be180dae9 req-65b4ac5e-1e1f-46c3-85fc-655340c8e7f6 service nova] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eed7d057-5099-44a7-bd3c-d07be180dae9 req-65b4ac5e-1e1f-46c3-85fc-655340c8e7f6 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eed7d057-5099-44a7-bd3c-d07be180dae9 req-65b4ac5e-1e1f-46c3-85fc-655340c8e7f6 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-eed7d057-5099-44a7-bd3c-d07be180dae9 req-65b4ac5e-1e1f-46c3-85fc-655340c8e7f6 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] No waiting events found dispatching network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:18 user nova-compute[74421]: WARNING nova.compute.manager [req-eed7d057-5099-44a7-bd3c-d07be180dae9 req-65b4ac5e-1e1f-46c3-85fc-655340c8e7f6 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received unexpected event network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a for instance with vm_state building and task_state spawning.
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Instance spawned successfully.
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:18 user nova-compute[74421]: INFO nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Took 10.02 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.network.neutron [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Successfully updated port: 04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:22:18 user nova-compute[74421]: INFO nova.compute.manager [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Took 11.28 seconds to build instance.
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquired lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.network.neutron [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-changed-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Refreshing instance network info cache due to event network-changed-04f12269-17e7-4d85-935d-1ecef64f8eba. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] Acquiring lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-af2194d2-4220-4af9-94d5-59ba6f7ae73d tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.498s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:18 user nova-compute[74421]: DEBUG nova.network.neutron [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.network.neutron [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Releasing lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Instance network_info: |[{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] Acquired lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.network.neutron [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Refreshing network info cache for port 04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Start _get_guest_xml network_info=[{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:19 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.objects.instance [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'pci_devices' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:22:19 user nova-compute[74421]:   <uuid>e7724770-32d5-49c0-98d4-a2f2f17f15a8</uuid>
Oct 23 15:22:19 user nova-compute[74421]:   <name>instance-00000008</name>
Oct 23 15:22:19 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:22:19 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:22:19 user nova-compute[74421]:   <metadata>
Oct 23 15:22:19 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:22:19 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:22:19 user nova-compute[74421]:       <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:22:19 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:22:19</nova:creationTime>
Oct 23 15:22:19 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:22:19 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:22:19 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:22:19 user nova-compute[74421]:       <nova:owner>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:22:19 user nova-compute[74421]:       </nova:owner>
Oct 23 15:22:19 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:22:19 user nova-compute[74421]:       <nova:ports>
Oct 23 15:22:19 user nova-compute[74421]:         <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:22:19 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:22:19 user nova-compute[74421]:         </nova:port>
Oct 23 15:22:19 user nova-compute[74421]:       </nova:ports>
Oct 23 15:22:19 user nova-compute[74421]:     </nova:instance>
Oct 23 15:22:19 user nova-compute[74421]:   </metadata>
Oct 23 15:22:19 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:22:19 user nova-compute[74421]:     <system>
Oct 23 15:22:19 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:22:19 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:22:19 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:22:19 user nova-compute[74421]:       <entry name="serial">e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:22:19 user nova-compute[74421]:       <entry name="uuid">e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:22:19 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:22:19 user nova-compute[74421]:     </system>
Oct 23 15:22:19 user nova-compute[74421]:   </sysinfo>
Oct 23 15:22:19 user nova-compute[74421]:   <os>
Oct 23 15:22:19 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:22:19 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:22:19 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:22:19 user nova-compute[74421]:   </os>
Oct 23 15:22:19 user nova-compute[74421]:   <features>
Oct 23 15:22:19 user nova-compute[74421]:     <acpi/>
Oct 23 15:22:19 user nova-compute[74421]:     <apic/>
Oct 23 15:22:19 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:22:19 user nova-compute[74421]:   </features>
Oct 23 15:22:19 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:22:19 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:22:19 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:22:19 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:22:19 user nova-compute[74421]:   </clock>
Oct 23 15:22:19 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:22:19 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:22:19 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:22:19 user nova-compute[74421]:   </cpu>
Oct 23 15:22:19 user nova-compute[74421]:   <devices>
Oct 23 15:22:19 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:22:19 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:22:19 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk"/>
Oct 23 15:22:19 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:22:19 user nova-compute[74421]:     </disk>
Oct 23 15:22:19 user nova-compute[74421]:     <disk type="file" device="cdrom">
Oct 23 15:22:19 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 15:22:19 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config"/>
Oct 23 15:22:19 user nova-compute[74421]:       <target dev="hda" bus="ide"/>
Oct 23 15:22:19 user nova-compute[74421]:     </disk>
Oct 23 15:22:19 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:22:19 user nova-compute[74421]:       <mac address="fa:16:3e:2a:3d:78"/>
Oct 23 15:22:19 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:22:19 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:22:19 user nova-compute[74421]:       <target dev="tap04f12269-17"/>
Oct 23 15:22:19 user nova-compute[74421]:     </interface>
Oct 23 15:22:19 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:22:19 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log" append="off"/>
Oct 23 15:22:19 user nova-compute[74421]:     </serial>
Oct 23 15:22:19 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:22:19 user nova-compute[74421]:     <video>
Oct 23 15:22:19 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:22:19 user nova-compute[74421]:     </video>
Oct 23 15:22:19 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:22:19 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:22:19 user nova-compute[74421]:     </rng>
Oct 23 15:22:19 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:22:19 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:22:19 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:22:19 user nova-compute[74421]:     </memballoon>
Oct 23 15:22:19 user nova-compute[74421]:   </devices>
Oct 23 15:22:19 user nova-compute[74421]: </domain>
Oct 23 15:22:19 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG os_vif [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7b4ecfa-5348-5e48-9d6c-216cf8eb508d', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04f12269-17, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04f12269-17, col_values=(('qos', UUID('13dd71f0-160b-44cf-af31-6250d565b8cf')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04f12269-17, col_values=(('external_ids', {'iface-id': '04f12269-17e7-4d85-935d-1ecef64f8eba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:3d:78', 'vm-uuid': 'e7724770-32d5-49c0-98d4-a2f2f17f15a8'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:19 user nova-compute[74421]: INFO os_vif [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17')
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No BDM found with device name hda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:22:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No VIF found with MAC fa:16:3e:2a:3d:78, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:22:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Using config drive
Oct 23 15:22:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Creating config drive at /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config
Oct 23 15:22:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp599xykku {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updated VIF entry in instance network info cache for port 04f12269-17e7-4d85-935d-1ecef64f8eba. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:22:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp599xykku" returned: 0 in 0.070s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5fb0d3c8-ce4e-4fe8-9321-f12f1891eea4 req-a6e39f7a-be75-42e4-bea6-65ce0443d0c2 service nova] Releasing lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd6faa45-c76d-4f25-b9e9-34b2eca41e65 req-d533880e-056e-455a-8ebc-707bca6a56bd service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd6faa45-c76d-4f25-b9e9-34b2eca41e65 req-d533880e-056e-455a-8ebc-707bca6a56bd service nova] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd6faa45-c76d-4f25-b9e9-34b2eca41e65 req-d533880e-056e-455a-8ebc-707bca6a56bd service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd6faa45-c76d-4f25-b9e9-34b2eca41e65 req-d533880e-056e-455a-8ebc-707bca6a56bd service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd6faa45-c76d-4f25-b9e9-34b2eca41e65 req-d533880e-056e-455a-8ebc-707bca6a56bd service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] No waiting events found dispatching network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:21 user nova-compute[74421]: WARNING nova.compute.manager [req-dd6faa45-c76d-4f25-b9e9-34b2eca41e65 req-d533880e-056e-455a-8ebc-707bca6a56bd service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received unexpected event network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc for instance with vm_state active and task_state None.
Oct 23 15:22:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:22:22 user nova-compute[74421]: INFO nova.compute.claims [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Claim successful on node user
Oct 23 15:22:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-ad6b9f04-ac04-4c01-a76d-6ac70b23b997 req-4786dc29-b248-4918-bf67-94e818b96e08 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ad6b9f04-ac04-4c01-a76d-6ac70b23b997 req-4786dc29-b248-4918-bf67-94e818b96e08 service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ad6b9f04-ac04-4c01-a76d-6ac70b23b997 req-4786dc29-b248-4918-bf67-94e818b96e08 service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ad6b9f04-ac04-4c01-a76d-6ac70b23b997 req-4786dc29-b248-4918-bf67-94e818b96e08 service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-ad6b9f04-ac04-4c01-a76d-6ac70b23b997 req-4786dc29-b248-4918-bf67-94e818b96e08 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:22 user nova-compute[74421]: WARNING nova.compute.manager [req-ad6b9f04-ac04-4c01-a76d-6ac70b23b997 req-4786dc29-b248-4918-bf67-94e818b96e08 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba for instance with vm_state building and task_state spawning.
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-db50f114-687d-4861-88fc-6035d5401479 req-10a78ddb-d008-429b-8db4-9820695232ec service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-db50f114-687d-4861-88fc-6035d5401479 req-10a78ddb-d008-429b-8db4-9820695232ec service nova] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-db50f114-687d-4861-88fc-6035d5401479 req-10a78ddb-d008-429b-8db4-9820695232ec service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-db50f114-687d-4861-88fc-6035d5401479 req-10a78ddb-d008-429b-8db4-9820695232ec service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-db50f114-687d-4861-88fc-6035d5401479 req-10a78ddb-d008-429b-8db4-9820695232ec service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] No waiting events found dispatching network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:23 user nova-compute[74421]: WARNING nova.compute.manager [req-db50f114-687d-4861-88fc-6035d5401479 req-10a78ddb-d008-429b-8db4-9820695232ec service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received unexpected event network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc for instance with vm_state active and task_state None.
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.083s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:22:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.policy [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5991af6144ca422195845fe38c37df25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13b83c4f78442a2a5602edb51aea4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:22:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Creating image(s)
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "/opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "/opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.245s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.206s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk 1073741824" returned: 0 in 0.160s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-33aa3344-4e57-42a2-b066-dd83bfd4af28 req-702ce031-0117-47aa-baee-c0d2f91c630b service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-33aa3344-4e57-42a2-b066-dd83bfd4af28 req-702ce031-0117-47aa-baee-c0d2f91c630b service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-33aa3344-4e57-42a2-b066-dd83bfd4af28 req-702ce031-0117-47aa-baee-c0d2f91c630b service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-33aa3344-4e57-42a2-b066-dd83bfd4af28 req-702ce031-0117-47aa-baee-c0d2f91c630b service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-33aa3344-4e57-42a2-b066-dd83bfd4af28 req-702ce031-0117-47aa-baee-c0d2f91c630b service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:24 user nova-compute[74421]: WARNING nova.compute.manager [req-33aa3344-4e57-42a2-b066-dd83bfd4af28 req-702ce031-0117-47aa-baee-c0d2f91c630b service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba for instance with vm_state building and task_state spawning.
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.259s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Successfully created port: dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Cannot resize image /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Ensure instance console log exists: /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:25 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Instance spawned successfully.
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:25 user nova-compute[74421]: INFO nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Took 8.98 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Successfully updated port: dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquired lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:22:25 user nova-compute[74421]: INFO nova.compute.manager [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Took 10.38 seconds to build instance.
Oct 23 15:22:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7332a0bd-7135-4f13-8121-b7db9af39026 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.570s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.compute.manager [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-changed-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.compute.manager [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Refreshing instance network info cache due to event network-changed-dd81742e-8f5e-40e5-baba-caff848f8bb9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] Acquiring lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updating instance_info_cache with network_info: [{"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Releasing lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Instance network_info: |[{"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] Acquired lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Refreshing network info cache for port dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Start _get_guest_xml network_info=[{"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:22:26 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:26 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1806191157',display_name='tempest-VolumesAssistedSnapshotsTest-server-1806191157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1806191157',id=9,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlbBGsAQmIW1sEYUWnhTwM/o1JJJbFKJmhs0zmBrWUX0SPypW7usHF/7D60EXFhVnoVWefNnKWq/uZ8O7VS54YN1A8HZhrMp11wmrppjchmVNz/rXWUdgOim1B+Nk8tIg==',key_name='tempest-keypair-127118244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f13b83c4f78442a2a5602edb51aea4da',ramdisk_id='',reservation_id='r-id506pyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1708900774',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1708900774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5991af6144ca422195845fe38c37df25',uuid=9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Converting VIF {"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:22:26 user nova-compute[74421]:   <uuid>9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9</uuid>
Oct 23 15:22:26 user nova-compute[74421]:   <name>instance-00000009</name>
Oct 23 15:22:26 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:22:26 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:22:26 user nova-compute[74421]:   <metadata>
Oct 23 15:22:26 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:22:26 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:22:26 user nova-compute[74421]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1806191157</nova:name>
Oct 23 15:22:26 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:22:26</nova:creationTime>
Oct 23 15:22:26 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:22:26 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:22:26 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:22:26 user nova-compute[74421]:       <nova:owner>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:user uuid="5991af6144ca422195845fe38c37df25">tempest-VolumesAssistedSnapshotsTest-1708900774-project-member</nova:user>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:project uuid="f13b83c4f78442a2a5602edb51aea4da">tempest-VolumesAssistedSnapshotsTest-1708900774</nova:project>
Oct 23 15:22:26 user nova-compute[74421]:       </nova:owner>
Oct 23 15:22:26 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:22:26 user nova-compute[74421]:       <nova:ports>
Oct 23 15:22:26 user nova-compute[74421]:         <nova:port uuid="dd81742e-8f5e-40e5-baba-caff848f8bb9">
Oct 23 15:22:26 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 15:22:26 user nova-compute[74421]:         </nova:port>
Oct 23 15:22:26 user nova-compute[74421]:       </nova:ports>
Oct 23 15:22:26 user nova-compute[74421]:     </nova:instance>
Oct 23 15:22:26 user nova-compute[74421]:   </metadata>
Oct 23 15:22:26 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:22:26 user nova-compute[74421]:     <system>
Oct 23 15:22:26 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:22:26 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:22:26 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:22:26 user nova-compute[74421]:       <entry name="serial">9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9</entry>
Oct 23 15:22:26 user nova-compute[74421]:       <entry name="uuid">9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9</entry>
Oct 23 15:22:26 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:22:26 user nova-compute[74421]:     </system>
Oct 23 15:22:26 user nova-compute[74421]:   </sysinfo>
Oct 23 15:22:26 user nova-compute[74421]:   <os>
Oct 23 15:22:26 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:22:26 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:22:26 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:22:26 user nova-compute[74421]:   </os>
Oct 23 15:22:26 user nova-compute[74421]:   <features>
Oct 23 15:22:26 user nova-compute[74421]:     <acpi/>
Oct 23 15:22:26 user nova-compute[74421]:     <apic/>
Oct 23 15:22:26 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:22:26 user nova-compute[74421]:   </features>
Oct 23 15:22:26 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:22:26 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:22:26 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:22:26 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:22:26 user nova-compute[74421]:   </clock>
Oct 23 15:22:26 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:22:26 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:22:26 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:22:26 user nova-compute[74421]:   </cpu>
Oct 23 15:22:26 user nova-compute[74421]:   <devices>
Oct 23 15:22:26 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:22:26 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:22:26 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk"/>
Oct 23 15:22:26 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:22:26 user nova-compute[74421]:     </disk>
Oct 23 15:22:26 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:22:26 user nova-compute[74421]:       <mac address="fa:16:3e:b2:6d:70"/>
Oct 23 15:22:26 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:22:26 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:22:26 user nova-compute[74421]:       <target dev="tapdd81742e-8f"/>
Oct 23 15:22:26 user nova-compute[74421]:     </interface>
Oct 23 15:22:26 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:22:26 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/console.log" append="off"/>
Oct 23 15:22:26 user nova-compute[74421]:     </serial>
Oct 23 15:22:26 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:22:26 user nova-compute[74421]:     <video>
Oct 23 15:22:26 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:22:26 user nova-compute[74421]:     </video>
Oct 23 15:22:26 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:22:26 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:22:26 user nova-compute[74421]:     </rng>
Oct 23 15:22:26 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:22:26 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:22:26 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:22:26 user nova-compute[74421]:     </memballoon>
Oct 23 15:22:26 user nova-compute[74421]:   </devices>
Oct 23 15:22:26 user nova-compute[74421]: </domain>
Oct 23 15:22:26 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1806191157',display_name='tempest-VolumesAssistedSnapshotsTest-server-1806191157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1806191157',id=9,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlbBGsAQmIW1sEYUWnhTwM/o1JJJbFKJmhs0zmBrWUX0SPypW7usHF/7D60EXFhVnoVWefNnKWq/uZ8O7VS54YN1A8HZhrMp11wmrppjchmVNz/rXWUdgOim1B+Nk8tIg==',key_name='tempest-keypair-127118244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f13b83c4f78442a2a5602edb51aea4da',ramdisk_id='',reservation_id='r-id506pyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1708900774',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1708900774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5991af6144ca422195845fe38c37df25',uuid=9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Converting VIF {"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG os_vif [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16c1fd8c-f6e6-58b4-b2e0-4f65838a6de4', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd81742e-8f, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd81742e-8f, col_values=(('qos', UUID('5e9eaba3-842c-4f30-88d6-c6bd57191ddd')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd81742e-8f, col_values=(('external_ids', {'iface-id': 'dd81742e-8f5e-40e5-baba-caff848f8bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:6d:70', 'vm-uuid': '9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:26 user nova-compute[74421]: INFO os_vif [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f')
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] No VIF found with MAC fa:16:3e:b2:6d:70, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updated VIF entry in instance network info cache for port dd81742e-8f5e-40e5-baba-caff848f8bb9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updating instance_info_cache with network_info: [{"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ae5f69fa-f81d-4a59-9c23-19403b5d4c48 req-ff103ec5-2290-4bc1-a7cb-823ba6041b7d service nova] Releasing lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-6a566134-383a-4033-af19-2e2a3365f3bb req-5158db69-2c22-4e7f-8f4b-cfd6d7901336 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a566134-383a-4033-af19-2e2a3365f3bb req-5158db69-2c22-4e7f-8f4b-cfd6d7901336 service nova] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a566134-383a-4033-af19-2e2a3365f3bb req-5158db69-2c22-4e7f-8f4b-cfd6d7901336 service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a566134-383a-4033-af19-2e2a3365f3bb req-5158db69-2c22-4e7f-8f4b-cfd6d7901336 service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-6a566134-383a-4033-af19-2e2a3365f3bb req-5158db69-2c22-4e7f-8f4b-cfd6d7901336 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] No waiting events found dispatching network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:27 user nova-compute[74421]: WARNING nova.compute.manager [req-6a566134-383a-4033-af19-2e2a3365f3bb req-5158db69-2c22-4e7f-8f4b-cfd6d7901336 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received unexpected event network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 for instance with vm_state building and task_state spawning.
Oct 23 15:22:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:22:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-9264f032-8c63-419c-8b9f-2f10cbe62986 req-34386dc5-145c-47cc-932f-ad95edded42f service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9264f032-8c63-419c-8b9f-2f10cbe62986 req-34386dc5-145c-47cc-932f-ad95edded42f service nova] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9264f032-8c63-419c-8b9f-2f10cbe62986 req-34386dc5-145c-47cc-932f-ad95edded42f service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9264f032-8c63-419c-8b9f-2f10cbe62986 req-34386dc5-145c-47cc-932f-ad95edded42f service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-9264f032-8c63-419c-8b9f-2f10cbe62986 req-34386dc5-145c-47cc-932f-ad95edded42f service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] No waiting events found dispatching network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:22:29 user nova-compute[74421]: WARNING nova.compute.manager [req-9264f032-8c63-419c-8b9f-2f10cbe62986 req-34386dc5-145c-47cc-932f-ad95edded42f service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received unexpected event network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 for instance with vm_state building and task_state spawning.
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:22:30 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Instance spawned successfully.
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:22:30 user nova-compute[74421]: INFO nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 23 15:22:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:22:30 user nova-compute[74421]: INFO nova.compute.manager [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Took 8.33 seconds to build instance.
Oct 23 15:22:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8b5cd114-bbac-4d9f-ac4d-f650dd58da04 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.577s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:22:32 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 110e0389-5c67-43c8-adff-dc9af9eff34e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updating instance_info_cache with network_info: [{"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:33 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:38 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:38 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:22:38 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=25.536590576171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:22:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1c23a9b-3859-4413-b85a-05dbb575f29b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 95dc4c72-5e91-4666-a31b-037e690c0e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e28652be-528a-454c-a4d1-2f35474f271a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:22:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.988s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:22:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:22:49 user nova-compute[74421]: INFO nova.compute.claims [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Claim successful on node user
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.network.neutron [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:22:49 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:22:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:22:50 user nova-compute[74421]: DEBUG nova.policy [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b95c80b39db4d168440aea6ba214333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f258e8819140888feb117e19e1758b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:22:50 user nova-compute[74421]: INFO nova.virt.block_device [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Booting with volume 71094d46-9be0-44cb-956e-1779b12eca5f at /dev/vda
Oct 23 15:22:50 user nova-compute[74421]: DEBUG os_brick.utils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:22:50 user nova-compute[74421]: INFO oslo.privsep.daemon [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpclmli_i_/privsep.sock']
Oct 23 15:22:50 user sudo[85614]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpclmli_i_/privsep.sock
Oct 23 15:22:50 user sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 15:22:50 user nova-compute[74421]: DEBUG nova.network.neutron [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Successfully created port: 92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Successfully updated port: 92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquired lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-changed-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Refreshing instance network info cache due to event network-changed-92806353-ba4b-4e20-b238-cf6d08443a8b. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] Acquiring lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:22:51 user sudo[85614]: pam_unix(sudo:session): session closed for user root
Oct 23 15:22:51 user nova-compute[74421]: INFO oslo.privsep.daemon [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Spawned new privsep daemon via rootwrap
Oct 23 15:22:51 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 15:22:51 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 15:22:51 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 23 15:22:51 user nova-compute[74421]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85617
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1977619f-303f-4173-917b-99fcee173181]: (2,) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updating instance_info_cache with network_info: [{"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Releasing lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance network_info: |[{"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] Acquired lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG nova.network.neutron [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Refreshing network info cache for port 92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc252b3-d7ba-40e0-a726-f36c91a0c020]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:22:51 user nova-compute[74421]: WARNING os_brick.initiator.connectors.nvmeof [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7f9a7a-d847-4c78-b106-de1b49638146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:22:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4765d2-0192-4db0-8d53-433859ec0ead]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f110f8c-3125-4fa5-acf1-21f5f494a34d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:22:52 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0525698b-4912-49f9-99c0-d7a20bda53b0]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== get_connector_properties: return (1922ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updating existing volume attachment record: b819b46c-74a8-43fb-b5a5-73c7a1acae26 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG nova.network.neutron [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updated VIF entry in instance network info cache for port 92806353-ba4b-4e20-b238-cf6d08443a8b. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG nova.network.neutron [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updating instance_info_cache with network_info: [{"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:22:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-24018d07-0332-43c9-bab0-fbdae4c84076 req-053a49c2-f96f-40e2-9ad1-ba4c23d5fe40 service nova] Releasing lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:22:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:22:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:23:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Creating image(s)
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Ensure instance console log exists: /opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Start _get_guest_xml network_info=[{"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'b819b46c-74a8-43fb-b5a5-73c7a1acae26', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46cfd9e6-88d4-48ee-af46-ab81bfcabd23', 'attached_at': '', 'detached_at': '', 'volume_id': '71094d46-9be0-44cb-956e-1779b12eca5f', 'serial': '71094d46-9be0-44cb-956e-1779b12eca5f'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:23:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:23:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connector [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Factory for ISCSI on None {{(pid=74421) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:23:09 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:23:09 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:23:09 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c39b852-1669-4ab7-acbe-96bc7ba3e533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:23:09 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a107fc8-1d11-42fc-a93c-9beae15010b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f] added
Oct 23 15:23:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d4bc3-2194-4d59-a74f-afc70a584efd]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b53a4-757d-4534-8db8-09676b93ac31]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFlRmYen {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFlRmYen" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b1e458-5786-43c9-9a8d-132a18d9633a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFlRmYen'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c964524-2ce4-4316-84bb-49f448f02b9d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[183a4eb1-2a25-402d-b6a7-19472b09819f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:23:09 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:23:09 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:23:09 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 15:23:09 user nova-compute[74421]: 
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ffe90-cac6-4143-a504-e13bd33bd42d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]
Oct 23 15:23:09 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.
Oct 23 15:23:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce12be88-7960-4cb1-b725-d81fd331d21b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337affb-a246-4a63-83ae-ac4dc4743125]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:23:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:23:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd6dea-b5eb-4c68-bffc-695ecf47cdb0]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:23:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23963396139356361', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396139356361', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1799553775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1799553775',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO75MIGajf4Vw0rXTyRtpSg+qnILL/OJtrCnJSVMDBhv5R1AbedUiPG4/up8ZrSFTDr6ikRP14S05M5xhw0sRohywM06zWPRCpRMWEriANOZNXkKi6kDB6U7/eSItRBg3A==',key_name='tempest-keypair-1846128662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9f258e8819140888feb117e19e1758b',ramdisk_id='',reservation_id='r-cbzjtcm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-595791159',owner_user_name='tempest-ServerActionsV293TestJSON-595791159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b95c80b39db4d168440aea6ba214333',uuid=46cfd9e6-88d4-48ee-af46-ab81bfcabd23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converting VIF {"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.objects.instance [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lazy-loading 'pci_devices' on Instance uuid 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:23:10 user nova-compute[74421]:   <uuid>46cfd9e6-88d4-48ee-af46-ab81bfcabd23</uuid>
Oct 23 15:23:10 user nova-compute[74421]:   <name>instance-0000000a</name>
Oct 23 15:23:10 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:23:10 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:23:10 user nova-compute[74421]:   <metadata>
Oct 23 15:23:10 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:23:10 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:23:10 user nova-compute[74421]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1799553775</nova:name>
Oct 23 15:23:10 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:23:09</nova:creationTime>
Oct 23 15:23:10 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:23:10 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:23:10 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:23:10 user nova-compute[74421]:       <nova:owner>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:user uuid="2b95c80b39db4d168440aea6ba214333">tempest-ServerActionsV293TestJSON-595791159-project-member</nova:user>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:project uuid="a9f258e8819140888feb117e19e1758b">tempest-ServerActionsV293TestJSON-595791159</nova:project>
Oct 23 15:23:10 user nova-compute[74421]:       </nova:owner>
Oct 23 15:23:10 user nova-compute[74421]:       <nova:ports>
Oct 23 15:23:10 user nova-compute[74421]:         <nova:port uuid="92806353-ba4b-4e20-b238-cf6d08443a8b">
Oct 23 15:23:10 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:23:10 user nova-compute[74421]:         </nova:port>
Oct 23 15:23:10 user nova-compute[74421]:       </nova:ports>
Oct 23 15:23:10 user nova-compute[74421]:     </nova:instance>
Oct 23 15:23:10 user nova-compute[74421]:   </metadata>
Oct 23 15:23:10 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:23:10 user nova-compute[74421]:     <system>
Oct 23 15:23:10 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:23:10 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:23:10 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:23:10 user nova-compute[74421]:       <entry name="serial">46cfd9e6-88d4-48ee-af46-ab81bfcabd23</entry>
Oct 23 15:23:10 user nova-compute[74421]:       <entry name="uuid">46cfd9e6-88d4-48ee-af46-ab81bfcabd23</entry>
Oct 23 15:23:10 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:23:10 user nova-compute[74421]:     </system>
Oct 23 15:23:10 user nova-compute[74421]:   </sysinfo>
Oct 23 15:23:10 user nova-compute[74421]:   <os>
Oct 23 15:23:10 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:23:10 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:23:10 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:23:10 user nova-compute[74421]:   </os>
Oct 23 15:23:10 user nova-compute[74421]:   <features>
Oct 23 15:23:10 user nova-compute[74421]:     <acpi/>
Oct 23 15:23:10 user nova-compute[74421]:     <apic/>
Oct 23 15:23:10 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:23:10 user nova-compute[74421]:   </features>
Oct 23 15:23:10 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:23:10 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:23:10 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:23:10 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:23:10 user nova-compute[74421]:   </clock>
Oct 23 15:23:10 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:23:10 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:23:10 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:23:10 user nova-compute[74421]:   </cpu>
Oct 23 15:23:10 user nova-compute[74421]:   <devices>
Oct 23 15:23:10 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:23:10 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:23:10 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:23:10 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:23:10 user nova-compute[74421]:       <serial>71094d46-9be0-44cb-956e-1779b12eca5f</serial>
Oct 23 15:23:10 user nova-compute[74421]:     </disk>
Oct 23 15:23:10 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:23:10 user nova-compute[74421]:       <mac address="fa:16:3e:81:63:37"/>
Oct 23 15:23:10 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:23:10 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:23:10 user nova-compute[74421]:       <target dev="tap92806353-ba"/>
Oct 23 15:23:10 user nova-compute[74421]:     </interface>
Oct 23 15:23:10 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:23:10 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23/console.log" append="off"/>
Oct 23 15:23:10 user nova-compute[74421]:     </serial>
Oct 23 15:23:10 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:23:10 user nova-compute[74421]:     <video>
Oct 23 15:23:10 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:23:10 user nova-compute[74421]:     </video>
Oct 23 15:23:10 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:23:10 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:23:10 user nova-compute[74421]:     </rng>
Oct 23 15:23:10 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:23:10 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:23:10 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:23:10 user nova-compute[74421]:     </memballoon>
Oct 23 15:23:10 user nova-compute[74421]:   </devices>
Oct 23 15:23:10 user nova-compute[74421]: </domain>
Oct 23 15:23:10 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1799553775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1799553775',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO75MIGajf4Vw0rXTyRtpSg+qnILL/OJtrCnJSVMDBhv5R1AbedUiPG4/up8ZrSFTDr6ikRP14S05M5xhw0sRohywM06zWPRCpRMWEriANOZNXkKi6kDB6U7/eSItRBg3A==',key_name='tempest-keypair-1846128662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9f258e8819140888feb117e19e1758b',ramdisk_id='',reservation_id='r-cbzjtcm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-595791159',owner_user_name='tempest-ServerActionsV293TestJSON-595791159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b95c80b39db4d168440aea6ba214333',uuid=46cfd9e6-88d4-48ee-af46-ab81bfcabd23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converting VIF {"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG os_vif [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6e69a63-de16-56ee-827e-c3fee24454e5', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92806353-ba, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92806353-ba, col_values=(('qos', UUID('fa256ac4-6adc-4ca0-9d7b-1512be16cb13')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92806353-ba, col_values=(('external_ids', {'iface-id': '92806353-ba4b-4e20-b238-cf6d08443a8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:63:37', 'vm-uuid': '46cfd9e6-88d4-48ee-af46-ab81bfcabd23'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:10 user nova-compute[74421]: INFO os_vif [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba')
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:23:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] No VIF found with MAC fa:16:3e:81:63:37, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:23:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-bbf6fafb-450f-46f1-afa4-fd59c08690e6 req-3b7a19ab-12c2-44cc-ae54-db5f76e5c2e0 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bbf6fafb-450f-46f1-afa4-fd59c08690e6 req-3b7a19ab-12c2-44cc-ae54-db5f76e5c2e0 service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bbf6fafb-450f-46f1-afa4-fd59c08690e6 req-3b7a19ab-12c2-44cc-ae54-db5f76e5c2e0 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bbf6fafb-450f-46f1-afa4-fd59c08690e6 req-3b7a19ab-12c2-44cc-ae54-db5f76e5c2e0 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-bbf6fafb-450f-46f1-afa4-fd59c08690e6 req-3b7a19ab-12c2-44cc-ae54-db5f76e5c2e0 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:23:12 user nova-compute[74421]: WARNING nova.compute.manager [req-bbf6fafb-450f-46f1-afa4-fd59c08690e6 req-3b7a19ab-12c2-44cc-ae54-db5f76e5c2e0 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state building and task_state spawning.
Oct 23 15:23:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-e2e550f0-1b0e-4f13-b657-b76a1194f9da req-b68278ce-e114-489a-b7a1-360dbb3da683 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e2e550f0-1b0e-4f13-b657-b76a1194f9da req-b68278ce-e114-489a-b7a1-360dbb3da683 service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e2e550f0-1b0e-4f13-b657-b76a1194f9da req-b68278ce-e114-489a-b7a1-360dbb3da683 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e2e550f0-1b0e-4f13-b657-b76a1194f9da req-b68278ce-e114-489a-b7a1-360dbb3da683 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-e2e550f0-1b0e-4f13-b657-b76a1194f9da req-b68278ce-e114-489a-b7a1-360dbb3da683 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:23:14 user nova-compute[74421]: WARNING nova.compute.manager [req-e2e550f0-1b0e-4f13-b657-b76a1194f9da req-b68278ce-e114-489a-b7a1-360dbb3da683 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state building and task_state spawning.
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:23:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance spawned successfully.
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:14 user nova-compute[74421]: INFO nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 23 15:23:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:23:14 user nova-compute[74421]: INFO nova.compute.manager [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Took 25.08 seconds to build instance.
Oct 23 15:23:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-988a896a-13bc-435e-8ed3-27a9c2672cc2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.186s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "87052596-1511-45a7-9c61-ec1631102126" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:19 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:23:19 user nova-compute[74421]: INFO nova.compute.claims [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Claim successful on node user
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:23:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:23:20 user nova-compute[74421]: INFO nova.virt.block_device [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Booting with volume d823c542-166b-4a0a-bba8-de97ef0885d8 at /dev/vda
Oct 23 15:23:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.policy [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17260e98ec464f34a1b55bae41d214c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8aab7a419a413b95836ec9f86e9a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39e3cb-3b53-4c82-9c58-7aa4408527ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce9201-a0a8-4ba0-9efc-20f69b24d5c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a759d-5e5b-4954-9bd9-5338a41b32c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8247ae3-57f2-403e-b80e-12bc9e2499e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:20 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:23:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dfc01b-03e1-4ff1-ba79-6631555dd1d5]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:23:20 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating existing volume attachment record: 2b3985ee-0505-4d9a-80d7-815a1b53cf98 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:23:21 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully created port: 8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:23:21 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully created port: ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:23:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully created port: 854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:23:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully created port: 481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:23:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully created port: d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: 8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-8f1298c0-12d7-4385-8d96-529658cbd8bf. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port 8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6611a329-f094-409a-8eb5-f0c2b0346684 req-fbdb4386-6691-4cea-80f2-a41a1f381c6c service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: 1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-1c372a91-7b22-4ec5-8c58-d90c25f64a8f. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port 1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:23:26 user nova-compute[74421]: INFO nova.compute.claims [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Claim successful on node user
Oct 23 15:23:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-b80e5cc8-6976-44d5-86b4-8ba0a1751053. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.network.neutron [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:23:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.policy [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ecc4a733599474d926e8feeda4e9328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1b4d9c12e94c4fa438af397abcff40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:23:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Creating image(s)
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "/opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "/opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "/opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6cbfc52c-f953-4e1f-bc94-a164c7233bca req-0a04c47c-e5c6-4c75-a023-962503db9ff2 service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.216s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk 1073741824" returned: 0 in 0.054s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.206s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Cannot resize image /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Ensure instance console log exists: /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.network.neutron [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Successfully created port: 45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-ffb51a57-114d-4445-b91b-bf80fae1e3a3. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.network.neutron [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.network.neutron [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:28 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: 854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG nova.network.neutron [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96c0b3c1-718e-4dd2-8455-ab1c780f100a req-da18d077-21d9-40fd-933c-6de92d8de69a service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Successfully updated port: 45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "refresh_cache-af892fbc-dcf3-4e7b-bfc4-e771919cd5df" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquired lock "refresh_cache-af892fbc-dcf3-4e7b-bfc4-e771919cd5df" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:23:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: 481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Updating instance_info_cache with network_info: [{"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Releasing lock "refresh_cache-af892fbc-dcf3-4e7b-bfc4-e771919cd5df" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Instance network_info: |[{"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Start _get_guest_xml network_info=[{"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:30 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:23:30 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-516147267',display_name='tempest-ServersNegativeTestJSON-server-516147267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-516147267',id=12,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab1b4d9c12e94c4fa438af397abcff40',ramdisk_id='',reservation_id='r-10gaweo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-297395355',owner_user_name='tempest-ServersNegativeTestJSON-297395355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:27Z,user_data=None,user_id='4ecc4a733599474d926e8feeda4e9328',uuid=af892fbc-dcf3-4e7b-bfc4-e771919cd5df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converting VIF {"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.objects.instance [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lazy-loading 'pci_devices' on Instance uuid af892fbc-dcf3-4e7b-bfc4-e771919cd5df {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:23:30 user nova-compute[74421]:   <uuid>af892fbc-dcf3-4e7b-bfc4-e771919cd5df</uuid>
Oct 23 15:23:30 user nova-compute[74421]:   <name>instance-0000000c</name>
Oct 23 15:23:30 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:23:30 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:23:30 user nova-compute[74421]:   <metadata>
Oct 23 15:23:30 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:23:30 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:23:30 user nova-compute[74421]:       <nova:name>tempest-ServersNegativeTestJSON-server-516147267</nova:name>
Oct 23 15:23:30 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:23:30</nova:creationTime>
Oct 23 15:23:30 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:23:30 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:23:30 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:23:30 user nova-compute[74421]:       <nova:owner>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:user uuid="4ecc4a733599474d926e8feeda4e9328">tempest-ServersNegativeTestJSON-297395355-project-member</nova:user>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:project uuid="ab1b4d9c12e94c4fa438af397abcff40">tempest-ServersNegativeTestJSON-297395355</nova:project>
Oct 23 15:23:30 user nova-compute[74421]:       </nova:owner>
Oct 23 15:23:30 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:23:30 user nova-compute[74421]:       <nova:ports>
Oct 23 15:23:30 user nova-compute[74421]:         <nova:port uuid="45b650de-ce78-4264-b0ed-c89d9872074a">
Oct 23 15:23:30 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:23:30 user nova-compute[74421]:         </nova:port>
Oct 23 15:23:30 user nova-compute[74421]:       </nova:ports>
Oct 23 15:23:30 user nova-compute[74421]:     </nova:instance>
Oct 23 15:23:30 user nova-compute[74421]:   </metadata>
Oct 23 15:23:30 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:23:30 user nova-compute[74421]:     <system>
Oct 23 15:23:30 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:23:30 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:23:30 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:23:30 user nova-compute[74421]:       <entry name="serial">af892fbc-dcf3-4e7b-bfc4-e771919cd5df</entry>
Oct 23 15:23:30 user nova-compute[74421]:       <entry name="uuid">af892fbc-dcf3-4e7b-bfc4-e771919cd5df</entry>
Oct 23 15:23:30 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:23:30 user nova-compute[74421]:     </system>
Oct 23 15:23:30 user nova-compute[74421]:   </sysinfo>
Oct 23 15:23:30 user nova-compute[74421]:   <os>
Oct 23 15:23:30 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:23:30 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:23:30 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:23:30 user nova-compute[74421]:   </os>
Oct 23 15:23:30 user nova-compute[74421]:   <features>
Oct 23 15:23:30 user nova-compute[74421]:     <acpi/>
Oct 23 15:23:30 user nova-compute[74421]:     <apic/>
Oct 23 15:23:30 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:23:30 user nova-compute[74421]:   </features>
Oct 23 15:23:30 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:23:30 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:23:30 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:23:30 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:23:30 user nova-compute[74421]:   </clock>
Oct 23 15:23:30 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:23:30 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:23:30 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:23:30 user nova-compute[74421]:   </cpu>
Oct 23 15:23:30 user nova-compute[74421]:   <devices>
Oct 23 15:23:30 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:23:30 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:23:30 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk"/>
Oct 23 15:23:30 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:23:30 user nova-compute[74421]:     </disk>
Oct 23 15:23:30 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:23:30 user nova-compute[74421]:       <mac address="fa:16:3e:bc:fd:59"/>
Oct 23 15:23:30 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:23:30 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:23:30 user nova-compute[74421]:       <target dev="tap45b650de-ce"/>
Oct 23 15:23:30 user nova-compute[74421]:     </interface>
Oct 23 15:23:30 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:23:30 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/console.log" append="off"/>
Oct 23 15:23:30 user nova-compute[74421]:     </serial>
Oct 23 15:23:30 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:23:30 user nova-compute[74421]:     <video>
Oct 23 15:23:30 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:23:30 user nova-compute[74421]:     </video>
Oct 23 15:23:30 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:23:30 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:23:30 user nova-compute[74421]:     </rng>
Oct 23 15:23:30 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:23:30 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:23:30 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:23:30 user nova-compute[74421]:     </memballoon>
Oct 23 15:23:30 user nova-compute[74421]:   </devices>
Oct 23 15:23:30 user nova-compute[74421]: </domain>
Oct 23 15:23:30 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-516147267',display_name='tempest-ServersNegativeTestJSON-server-516147267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-516147267',id=12,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab1b4d9c12e94c4fa438af397abcff40',ramdisk_id='',reservation_id='r-10gaweo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-297395355',owner_user_name='tempest-ServersNegativeTestJSON-297395355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:27Z,user_data=None,user_id='4ecc4a733599474d926e8feeda4e9328',uuid=af892fbc-dcf3-4e7b-bfc4-e771919cd5df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converting VIF {"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG os_vif [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac2044fb-5a98-5c6d-bbbb-ec370394735b', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45b650de-ce, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45b650de-ce, col_values=(('qos', UUID('7fa6e5de-04b9-4da1-9527-a17b250f5d01')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45b650de-ce, col_values=(('external_ids', {'iface-id': '45b650de-ce78-4264-b0ed-c89d9872074a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:fd:59', 'vm-uuid': 'af892fbc-dcf3-4e7b-bfc4-e771919cd5df'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:30 user nova-compute[74421]: INFO os_vif [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce')
Oct 23 15:23:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-854534dd-636d-4e62-af3d-9fd900fe1d78. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port 854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] No VIF found with MAC fa:16:3e:bc:fd:59, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:23:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Successfully updated port: d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-changed-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Refreshing instance network info cache due to event network-changed-45b650de-ce78-4264-b0ed-c89d9872074a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Acquiring lock "refresh_cache-af892fbc-dcf3-4e7b-bfc4-e771919cd5df" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Acquired lock "refresh_cache-af892fbc-dcf3-4e7b-bfc4-e771919cd5df" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Refreshing network info cache for port 45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Updated VIF entry in instance network info cache for port 45b650de-ce78-4264-b0ed-c89d9872074a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Updating instance_info_cache with network_info: [{"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Releasing lock "refresh_cache-af892fbc-dcf3-4e7b-bfc4-e771919cd5df" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-481adf48-b512-49e3-abd7-e074512d979d. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-d67be639-fd23-4ae1-b53f-f54208efd988. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance network_info: |[{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port 481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updated VIF entry in instance network info cache for port 481adf48-b512-49e3-abd7-e074512d979d. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.network.neutron [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4ee3ac05-cb7f-4a9c-89cc-c5151e58f560 req-7dbe418e-d3fb-43e2-a9f0-a7c5f879d559 service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.network.neutron [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:23:34 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Instance spawned successfully.
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:23:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:34 user nova-compute[74421]: INFO nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Took 7.00 seconds to spawn the instance on the hypervisor.
Oct 23 15:23:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:23:34 user nova-compute[74421]: INFO nova.compute.manager [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Took 7.96 seconds to build instance.
Oct 23 15:23:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-219d96c4-2fe8-4295-9c92-b66794e7946f tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.067s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updating instance_info_cache with network_info: [{"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-d1c23a9b-3859-4413-b85a-05dbb575f29b" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updated VIF entry in instance network info cache for port d67be639-fd23-4ae1-b53f-f54208efd988. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] No waiting events found dispatching network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:23:35 user nova-compute[74421]: WARNING nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received unexpected event network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a for instance with vm_state building and task_state spawning.
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] No waiting events found dispatching network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:23:35 user nova-compute[74421]: WARNING nova.compute.manager [req-252bf848-c1d1-41f8-a608-d31e4b302a61 req-1b9e40bb-c48d-4620-b2b1-c6de1c11c784 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received unexpected event network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a for instance with vm_state building and task_state spawning.
Oct 23 15:23:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-changed-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Refreshing instance network info cache due to event network-changed-84cc0fa9-3418-448b-9c04-36388db48a87. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] Acquiring lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] Acquired lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Refreshing network info cache for port 84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG nova.network.neutron [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updated VIF entry in instance network info cache for port 84cc0fa9-3418-448b-9c04-36388db48a87. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG nova.network.neutron [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updating instance_info_cache with network_info: [{"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a80c6de5-108a-4f47-b6b2-02a6b57de0c2 req-10f48724-fa97-4698-b90b-3620b794d526 service nova] Releasing lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-changed-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Refreshing instance network info cache due to event network-changed-4601ea46-2069-471a-8de8-0547b9aea8c9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Refreshing network info cache for port 4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:38 user nova-compute[74421]: INFO nova.compute.manager [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] instance snapshotting
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.network.neutron [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updated VIF entry in instance network info cache for port 4601ea46-2069-471a-8de8-0547b9aea8c9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.network.neutron [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-85d8bd8f-9a33-457a-beb9-4b32375ee9c0 req-4ef1a9ba-941a-4410-8c09-a194de62e40a service nova] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:38 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Beginning live snapshot process
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-changed-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Refreshing instance network info cache due to event network-changed-7dd217a3-a501-4e28-a7f6-659356f41eca. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:38 user nova-compute[74421]: DEBUG nova.network.neutron [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Refreshing network info cache for port 7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg8sko9wd/ae474fc2decf4a26a159010ae5b15c55.delta 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG nova.network.neutron [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updated VIF entry in instance network info cache for port 7dd217a3-a501-4e28-a7f6-659356f41eca. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG nova.network.neutron [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg8sko9wd/ae474fc2decf4a26a159010ae5b15c55.delta 1073741824" returned: 0 in 0.082s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 15:23:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74421) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 23 15:23:39 user nova-compute[74421]: INFO nova.virt.libvirt.host [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] UEFI support detected
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-46f09ab0-36ad-45b9-9eba-5a87a236b5db req-04e9be7c-d182-48b9-baa4-ea4624910c70 service nova] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:23:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7000MB free_disk=25.442733764648438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:23:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg8sko9wd/ae474fc2decf4a26a159010ae5b15c55.delta /opt/stack/data/nova/instances/snapshots/tmpg8sko9wd/ae474fc2decf4a26a159010ae5b15c55 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1c23a9b-3859-4413-b85a-05dbb575f29b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 95dc4c72-5e91-4666-a31b-037e690c0e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e28652be-528a-454c-a4d1-2f35474f271a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 87052596-1511-45a7-9c61-ec1631102126 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance af892fbc-dcf3-4e7b-bfc4-e771919cd5df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:23:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg8sko9wd/ae474fc2decf4a26a159010ae5b15c55.delta /opt/stack/data/nova/instances/snapshots/tmpg8sko9wd/ae474fc2decf4a26a159010ae5b15c55" returned: 0 in 0.539s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Snapshot extracted, beginning image upload
Oct 23 15:23:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid 95dc4c72-5e91-4666-a31b-037e690c0e6d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:42 user nova-compute[74421]: INFO nova.compute.manager [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Attaching volume 0cc03a24-8c38-4c17-a67f-3f3c2c31e141 to /dev/vdb
Oct 23 15:23:42 user nova-compute[74421]: DEBUG os_brick.utils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24c728-fe49-4ba8-80e6-e4e794807bd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e00cf-d138-4ad7-b540-754910f4b528]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca91d2e-6bd9-498a-a45e-99c151b7f23e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565b246-3cb8-4596-8623-2350912f90a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:42 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:23:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bb6cfb-4e7c-4f00-bd40-564bc37acd28]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG os_brick.utils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:23:42 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updating existing volume attachment record: 1b201456-a737-4080-afe1-b2dec4481076 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:23:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:23:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Snapshot image upload complete
Oct 23 15:23:44 user nova-compute[74421]: INFO nova.compute.manager [None req-6b7c5ab7-916b-4b49-ac3b-8c06d6a3441e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Took 6.19 seconds to snapshot the instance on the hypervisor.
Oct 23 15:23:44 user nova-compute[74421]: INFO nova.virt.block_device [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Booting with volume ce683976-8617-4a06-b859-9cd386d2951a at /dev/vdb
Oct 23 15:23:44 user nova-compute[74421]: DEBUG os_brick.utils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:23:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa088d-e0aa-4688-8ad1-ccee0d379325]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d376450-81a7-4dc3-b152-919a262aa73f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c580ea-9c42-46ab-ae2f-6fd379387559]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[11515e82-61da-4ba6-bd4d-0e3a09103a3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:45 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:23:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd41aa-74d4-4a8c-aaf6-b88f4115591e]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG os_brick.utils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating existing volume attachment record: 42b3b704-61a2-4804-9154-045a6f3121ad {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:23:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG nova.objects.instance [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lazy-loading 'flavor' on Instance uuid d1c23a9b-3859-4413-b85a-05dbb575f29b {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:23:46 user nova-compute[74421]: INFO nova.compute.manager [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Attaching volume 39eda0bd-27a2-4466-bc95-bb4ed4f49aab to /dev/vdb
Oct 23 15:23:46 user nova-compute[74421]: DEBUG os_brick.utils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58b89c-a718-4683-95f8-97cb61520445]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd0b9ea-15e7-419d-97e8-2f9c2fd9ad28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.011s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be4bba-f58d-4ddf-a7c3-4c90877e37c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4303f7-7052-4ea7-853c-2c26a12d5821]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:23:46 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:23:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f103f9ec-58a7-4883-9157-e472c0251a8a]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG os_brick.utils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:23:46 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updating existing volume attachment record: bfc1a702-75b1-4006-b624-72a2f22b5966 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:23:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:23:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-changed-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:23:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Refreshing instance network info cache due to event network-changed-9fecdec2-d2d3-4248-8541-4b96c3b1409a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:23:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] Acquiring lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:23:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] Acquired lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:23:57 user nova-compute[74421]: DEBUG nova.network.neutron [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Refreshing network info cache for port 9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:23:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updated VIF entry in instance network info cache for port 9fecdec2-d2d3-4248-8541-4b96c3b1409a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:23:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updating instance_info_cache with network_info: [{"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:23:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-823a223f-e630-49db-9b68-35bdee6b5803 req-05838d0f-996e-4d96-8f90-323e7f59fbd0 service nova] Releasing lock "refresh_cache-e28652be-528a-454c-a4d1-2f35474f271a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:23:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-changed-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Refreshing instance network info cache due to event network-changed-04f12269-17e7-4d85-935d-1ecef64f8eba. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] Acquiring lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] Acquired lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Refreshing network info cache for port 04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "interface-e7724770-32d5-49c0-98d4-a2f2f17f15a8-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "interface-e7724770-32d5-49c0-98d4-a2f2f17f15a8-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'flavor' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updated VIF entry in instance network info cache for port 04f12269-17e7-4d85-935d-1ecef64f8eba. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f20ac7cc-b9ca-4bc4-acde-805e343d2890 req-bb6f26a9-3266-4508-984a-f93e6db46940 service nova] Releasing lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'pci_requests' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.objects.base [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Object Instance<e7724770-32d5-49c0-98d4-a2f2f17f15a8> lazy-loaded attributes: flavor,pci_requests {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:24:06 user nova-compute[74421]: DEBUG nova.policy [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b83377d1f6643c696cce0af08335438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8557c583d6da4580af96f29504437579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:24:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:07 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Successfully created port: 4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Successfully updated port: 4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquired lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-changed-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Refreshing instance network info cache due to event network-changed-4011a046-1acf-4911-b4cc-2e40e63dda1e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] Acquiring lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Releasing lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] Acquired lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Refreshing network info cache for port 4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG os_vif [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5645ebf4-ba76-59ab-9d9c-2b1f2ec1b569', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4011a046-1a, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4011a046-1a, col_values=(('qos', UUID('c08020ee-0499-4e09-bdf3-2e9dfe080a80')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4011a046-1a, col_values=(('external_ids', {'iface-id': '4011a046-1acf-4911-b4cc-2e40e63dda1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:73:d6', 'vm-uuid': 'e7724770-32d5-49c0-98d4-a2f2f17f15a8'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: INFO os_vif [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a')
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] attach device xml: <interface type="ethernet">
Oct 23 15:24:08 user nova-compute[74421]:   <mac address="fa:16:3e:ca:73:d6"/>
Oct 23 15:24:08 user nova-compute[74421]:   <model type="virtio"/>
Oct 23 15:24:08 user nova-compute[74421]:   <mtu size="1442"/>
Oct 23 15:24:08 user nova-compute[74421]:   <target dev="tap4011a046-1a"/>
Oct 23 15:24:08 user nova-compute[74421]: </interface>
Oct 23 15:24:08 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No BDM found with device name hda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No VIF found with MAC fa:16:3e:2a:3d:78, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:24:09 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:24:09 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:24:09 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:24:09</nova:creationTime>
Oct 23 15:24:09 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:24:09 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:24:09 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:24:09 user nova-compute[74421]:   <nova:owner>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:24:09 user nova-compute[74421]:   </nova:owner>
Oct 23 15:24:09 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:24:09 user nova-compute[74421]:   <nova:ports>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:24:09 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:24:09 user nova-compute[74421]:     </nova:port>
Oct 23 15:24:09 user nova-compute[74421]:     <nova:port uuid="4011a046-1acf-4911-b4cc-2e40e63dda1e">
Oct 23 15:24:09 user nova-compute[74421]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Oct 23 15:24:09 user nova-compute[74421]:     </nova:port>
Oct 23 15:24:09 user nova-compute[74421]:   </nova:ports>
Oct 23 15:24:09 user nova-compute[74421]: </nova:instance>
Oct 23 15:24:09 user nova-compute[74421]:  {{(pid=74421) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad6bf41d-480a-465d-a44d-7b438df74f97 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "interface-e7724770-32d5-49c0-98d4-a2f2f17f15a8-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.848s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updated VIF entry in instance network info cache for port 4011a046-1acf-4911-b4cc-2e40e63dda1e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b3ae9a3-287b-4b20-8e1e-6bd7da5f791a req-2b8249f3-2c92-459c-bee5-ece0daca37cf service nova] Releasing lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:24:10 user nova-compute[74421]: WARNING nova.compute.manager [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e for instance with vm_state active and task_state None.
Oct 23 15:24:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:24:10 user nova-compute[74421]: WARNING nova.compute.manager [req-8cc3df95-aac0-46ca-93cc-f79b0f92e2c0 req-c0f578c7-831b-40dc-af99-9ad10d69bb0c service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e for instance with vm_state active and task_state None.
Oct 23 15:24:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJdyGuWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:11 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:11 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:11 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f782ba1b-7fe7-47c7-92be-b2e239e07819]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:24:11 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a454a5d-5c14-41b0-b7a5-e5d72cc6018c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141] added
Oct 23 15:24:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82818f6-1c49-479f-a2ec-6cc012ab63f1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9266f4f-cd67-41c2-8735-423aa302667d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJdyGuWf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJdyGuWf" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0037213-2587-4a53-8e38-d05f9d8ad243]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJdyGuWf'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1e182-0e70-432a-ae92-4235d2b926a8]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05409b5-c94b-4702-aa69-6623b0efdcc1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e483b77-20a1-4fc4-b001-df79f44975c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260]
Oct 23 15:24:12 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260] successful.
Oct 23 15:24:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3274ebf-eaba-49ee-9b50-4d447400b88d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b8d03-d205-45c5-a4ff-dd8c4a700fd9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:12 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:12 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.129s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c648b-1ac4-48fe-b028-4b56852a3864]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJdyGuWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG nova.objects.instance [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'flavor' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:12 user nova-compute[74421]: INFO nova.compute.manager [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Attaching volume 03a0fa26-7e77-4026-9c2c-3528c5bbc135 to /dev/vdb
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.utils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b5096-44ac-410a-bd04-0da1aafbc2be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac77e77-fa95-4e19-a5bf-795eca1f2110]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53729be-d063-4416-be7a-369b9638000b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e01da67-90ea-40a0-a101-417e715d16eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:13 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:24:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09be40-eae3-4365-9bbc-3323595a4674]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG os_brick.utils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating existing volume attachment record: 735e981e-e51d-4ba3-b6bc-c3d5764e40c9 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-changed-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Refreshing instance network info cache due to event network-changed-dd81742e-8f5e-40e5-baba-caff848f8bb9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] Acquiring lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] Acquired lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Refreshing network info cache for port dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23439346336383230', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439346336383230', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid 95dc4c72-5e91-4666-a31b-037e690c0e6d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:24:13 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:24:13 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:24:13 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:24:13 user nova-compute[74421]:   <serial>0cc03a24-8c38-4c17-a67f-3f3c2c31e141</serial>
Oct 23 15:24:13 user nova-compute[74421]: </disk>
Oct 23 15:24:13 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updated VIF entry in instance network info cache for port dd81742e-8f5e-40e5-baba-caff848f8bb9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updating instance_info_cache with network_info: [{"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0ba6b4e-8369-49a9-b1da-0b707c70dbc7 req-ec98e392-1709-4d65-adab-33244b5a8cf9 service nova] Releasing lock "refresh_cache-9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:29:d4:84, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:24:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmZoLpyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:19 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:19 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:19 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8498d48e-9c69-4bc5-b2c2-030a2bf655f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:24:19 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2217988c-ea63-4ecb-9f09-71d39968dc7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab] added
Oct 23 15:24:19 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG nova.objects.instance [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lazy-loading 'flavor' on Instance uuid 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ec464-f030-4065-ab74-082afa14db22]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8d2291-ac20-4f50-a66a-dce013896053]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-93f3622d-beea-449a-be56-dcbd05a54167 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.199s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmZoLpyv {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmZoLpyv" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c25ed-6799-4421-b7ee-b4ec87f61d90]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xmZoLpyv'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9efc532-fcc2-4149-9866-d3ba90e4b52f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.519s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:20 user nova-compute[74421]: INFO nova.virt.block_device [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Booting with volume 4d7321a0-478d-4bb2-81a5-3c226c2eb42d at /dev/vdc
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8357ab19-d193-4d9d-8a90-55aa190af3ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG nova.objects.instance [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lazy-loading 'flavor' on Instance uuid e28652be-528a-454c-a4d1-2f35474f271a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:20 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:20 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe82996-12b6-4163-9416-e84e36a315eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260]
Oct 23 15:24:20 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260] successful.
Oct 23 15:24:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[393e2140-47dd-4b5b-b96e-e3855b80f02e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7ad9b-19d9-42f7-98d3-f88ac1d2717d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77d1d1-03c0-44bf-a271-5eff73645644]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac3ec93-a256-456a-bed1-bb9b20b98719]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:20 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:20 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:20 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:20 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.778s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[87816382-7085-4fce-a7b5-4f056006d974]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d6413f-bf4c-470e-8730-7b9ebca8a268]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a195e9-60f1-4047-be18-348049483b4d]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmZoLpyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:20 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c509f67c-60b2-4dd1-86b1-66e4d0614408]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating existing volume attachment record: 616c7008-c709-4fc2-abfd-367156cdc285 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:20 user nova-compute[74421]: INFO nova.compute.manager [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Attaching volume 7efba4e2-5300-409d-a0e6-44da86522de4 to /dev/sdc
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:20 user nova-compute[74421]: INFO nova.compute.manager [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Attaching volume 90b425ae-09df-4064-a354-00c9b4d3c169 to /dev/vdb
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4d91e2-a7a6-452e-93fa-3a8fe811419d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eade3d-12c8-4713-bca4-f4cec7fc4513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca6454-075c-4d6a-92b3-0944cea1cccf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd03f372-7658-42e0-bf08-f169e492645c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989ba82-d75b-49f5-9ebf-32f1ad17cf83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:20 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05c3a2-0a57-4eb8-a526-a76a4d9e0b4c]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updating existing volume attachment record: deda528d-e33e-42b7-b8ab-f061b427ad63 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b31cd-6348-459f-a148-f7e3c764865b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6ee6a8-8131-48d9-a170-adf713fba7fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d244590d-7f7d-48ac-8fb2-de10878cd7d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:24:20 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:24:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83df10d-9ff6-4d22-8e6c-f9244f825fed]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:20 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updating existing volume attachment record: 9d6a80c0-ec02-4381-a26e-33d663ba5911 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.867s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] <== connect_volume: return (1879ms) {'type': 'block', 'scsi_wwn': '23532653536633538', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532653536633538', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG nova.objects.instance [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lazy-loading 'flavor' on Instance uuid d1c23a9b-3859-4413-b85a-05dbb575f29b {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:24:21 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:24:21 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:24:21 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:24:21 user nova-compute[74421]:   <serial>39eda0bd-27a2-4466-bc95-bb4ed4f49aab</serial>
Oct 23 15:24:21 user nova-compute[74421]: </disk>
Oct 23 15:24:21 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] No VIF found with MAC fa:16:3e:fa:47:b4, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "62358513-c579-4486-925b-98371a35f1bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:24:22 user nova-compute[74421]: INFO nova.compute.claims [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Claim successful on node user
Oct 23 15:24:22 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:24:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.policy [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e711d55fe644a0ca518fa34d187b79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e90bcb97e74feaa5e6247b7fc0d3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:24:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Creating image(s)
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "/opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.171s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk 1073741824" returned: 0 in 0.047s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:24:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Cannot resize image /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Ensure instance console log exists: /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Successfully created port: 0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Successfully updated port: 0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquired lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-changed-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Refreshing instance network info cache due to event network-changed-0fb10811-2884-415d-8dc7-edb887d2e0b7. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] Acquiring lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updating instance_info_cache with network_info: [{"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Releasing lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Instance network_info: |[{"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] Acquired lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Refreshing network info cache for port 0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Start _get_guest_xml network_info=[{"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:24:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:24:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-488042625',display_name='tempest-AttachVolumeNegativeTest-server-488042625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-488042625',id=13,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLls99mDl0xCXu753OJVzVLld/luAIARRtY4bFEBBYRXcd02x+kAz9TwILLX/JD22K5C4IVaB/CICESxR+BWqZ2vGo92HVZIHAHKEi1QJvAWNJN6CI32iNhWc0audzuK0w==',key_name='tempest-keypair-1473412201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-nd9clani',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=62358513-c579-4486-925b-98371a35f1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'pci_devices' on Instance uuid 62358513-c579-4486-925b-98371a35f1bf {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:24:25 user nova-compute[74421]:   <uuid>62358513-c579-4486-925b-98371a35f1bf</uuid>
Oct 23 15:24:25 user nova-compute[74421]:   <name>instance-0000000d</name>
Oct 23 15:24:25 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:24:25 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:24:25 user nova-compute[74421]:   <metadata>
Oct 23 15:24:25 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:24:25 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:24:25 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeNegativeTest-server-488042625</nova:name>
Oct 23 15:24:25 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:24:25</nova:creationTime>
Oct 23 15:24:25 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:24:25 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:24:25 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:24:25 user nova-compute[74421]:       <nova:owner>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:user uuid="1e711d55fe644a0ca518fa34d187b79f">tempest-AttachVolumeNegativeTest-100322526-project-member</nova:user>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:project uuid="74e90bcb97e74feaa5e6247b7fc0d3f2">tempest-AttachVolumeNegativeTest-100322526</nova:project>
Oct 23 15:24:25 user nova-compute[74421]:       </nova:owner>
Oct 23 15:24:25 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:24:25 user nova-compute[74421]:       <nova:ports>
Oct 23 15:24:25 user nova-compute[74421]:         <nova:port uuid="0fb10811-2884-415d-8dc7-edb887d2e0b7">
Oct 23 15:24:25 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:24:25 user nova-compute[74421]:         </nova:port>
Oct 23 15:24:25 user nova-compute[74421]:       </nova:ports>
Oct 23 15:24:25 user nova-compute[74421]:     </nova:instance>
Oct 23 15:24:25 user nova-compute[74421]:   </metadata>
Oct 23 15:24:25 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:24:25 user nova-compute[74421]:     <system>
Oct 23 15:24:25 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:24:25 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:24:25 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:24:25 user nova-compute[74421]:       <entry name="serial">62358513-c579-4486-925b-98371a35f1bf</entry>
Oct 23 15:24:25 user nova-compute[74421]:       <entry name="uuid">62358513-c579-4486-925b-98371a35f1bf</entry>
Oct 23 15:24:25 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:24:25 user nova-compute[74421]:     </system>
Oct 23 15:24:25 user nova-compute[74421]:   </sysinfo>
Oct 23 15:24:25 user nova-compute[74421]:   <os>
Oct 23 15:24:25 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:24:25 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:24:25 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:24:25 user nova-compute[74421]:   </os>
Oct 23 15:24:25 user nova-compute[74421]:   <features>
Oct 23 15:24:25 user nova-compute[74421]:     <acpi/>
Oct 23 15:24:25 user nova-compute[74421]:     <apic/>
Oct 23 15:24:25 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:24:25 user nova-compute[74421]:   </features>
Oct 23 15:24:25 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:24:25 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:24:25 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:24:25 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:24:25 user nova-compute[74421]:   </clock>
Oct 23 15:24:25 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:24:25 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:24:25 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:24:25 user nova-compute[74421]:   </cpu>
Oct 23 15:24:25 user nova-compute[74421]:   <devices>
Oct 23 15:24:25 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:24:25 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:24:25 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk"/>
Oct 23 15:24:25 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:24:25 user nova-compute[74421]:     </disk>
Oct 23 15:24:25 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:24:25 user nova-compute[74421]:       <mac address="fa:16:3e:93:6f:8b"/>
Oct 23 15:24:25 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:24:25 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:24:25 user nova-compute[74421]:       <target dev="tap0fb10811-28"/>
Oct 23 15:24:25 user nova-compute[74421]:     </interface>
Oct 23 15:24:25 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:24:25 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/console.log" append="off"/>
Oct 23 15:24:25 user nova-compute[74421]:     </serial>
Oct 23 15:24:25 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:24:25 user nova-compute[74421]:     <video>
Oct 23 15:24:25 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:24:25 user nova-compute[74421]:     </video>
Oct 23 15:24:25 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:24:25 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:24:25 user nova-compute[74421]:     </rng>
Oct 23 15:24:25 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:24:25 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:24:25 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:24:25 user nova-compute[74421]:     </memballoon>
Oct 23 15:24:25 user nova-compute[74421]:   </devices>
Oct 23 15:24:25 user nova-compute[74421]: </domain>
Oct 23 15:24:25 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-488042625',display_name='tempest-AttachVolumeNegativeTest-server-488042625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-488042625',id=13,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLls99mDl0xCXu753OJVzVLld/luAIARRtY4bFEBBYRXcd02x+kAz9TwILLX/JD22K5C4IVaB/CICESxR+BWqZ2vGo92HVZIHAHKEi1QJvAWNJN6CI32iNhWc0audzuK0w==',key_name='tempest-keypair-1473412201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-nd9clani',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=62358513-c579-4486-925b-98371a35f1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG os_vif [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9461ac5-3d8d-50b3-a2aa-725a72960625', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fb10811-28, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fb10811-28, col_values=(('qos', UUID('3ee8f7f4-03fa-47e7-8230-765b8f1dc362')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fb10811-28, col_values=(('external_ids', {'iface-id': '0fb10811-2884-415d-8dc7-edb887d2e0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:6f:8b', 'vm-uuid': '62358513-c579-4486-925b-98371a35f1bf'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:25 user nova-compute[74421]: INFO os_vif [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28')
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:93:6f:8b, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updated VIF entry in instance network info cache for port 0fb10811-2884-415d-8dc7-edb887d2e0b7. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updating instance_info_cache with network_info: [{"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aec10cde-2313-4d83-98c5-bb422fdb137d req-2ce70690-563c-4b6d-a024-6c7340285cc6 service nova] Releasing lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-a2b63394-e00e-43f9-b9a4-20f534328a0a req-b95d1755-e0be-4461-862b-db001e7f2c85 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a2b63394-e00e-43f9-b9a4-20f534328a0a req-b95d1755-e0be-4461-862b-db001e7f2c85 service nova] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a2b63394-e00e-43f9-b9a4-20f534328a0a req-b95d1755-e0be-4461-862b-db001e7f2c85 service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a2b63394-e00e-43f9-b9a4-20f534328a0a req-b95d1755-e0be-4461-862b-db001e7f2c85 service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-a2b63394-e00e-43f9-b9a4-20f534328a0a req-b95d1755-e0be-4461-862b-db001e7f2c85 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] No waiting events found dispatching network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:24:26 user nova-compute[74421]: WARNING nova.compute.manager [req-a2b63394-e00e-43f9-b9a4-20f534328a0a req-b95d1755-e0be-4461-862b-db001e7f2c85 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received unexpected event network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 for instance with vm_state building and task_state spawning.
Oct 23 15:24:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:24:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 62358513-c579-4486-925b-98371a35f1bf] Instance spawned successfully.
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:24:28 user nova-compute[74421]: INFO nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Took 5.48 seconds to spawn the instance on the hypervisor.
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-e01d3cd0-d4f6-401f-8e4b-c4e38408ed97 req-101451b1-b01a-4795-9881-7afbc18bd04e service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e01d3cd0-d4f6-401f-8e4b-c4e38408ed97 req-101451b1-b01a-4795-9881-7afbc18bd04e service nova] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e01d3cd0-d4f6-401f-8e4b-c4e38408ed97 req-101451b1-b01a-4795-9881-7afbc18bd04e service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e01d3cd0-d4f6-401f-8e4b-c4e38408ed97 req-101451b1-b01a-4795-9881-7afbc18bd04e service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-e01d3cd0-d4f6-401f-8e4b-c4e38408ed97 req-101451b1-b01a-4795-9881-7afbc18bd04e service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] No waiting events found dispatching network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:24:28 user nova-compute[74421]: WARNING nova.compute.manager [req-e01d3cd0-d4f6-401f-8e4b-c4e38408ed97 req-101451b1-b01a-4795-9881-7afbc18bd04e service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received unexpected event network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 for instance with vm_state building and task_state spawning.
Oct 23 15:24:28 user nova-compute[74421]: INFO nova.compute.manager [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Took 6.29 seconds to build instance.
Oct 23 15:24:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b7400a61-2097-4044-841c-0b0ec4daafd5 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "62358513-c579-4486-925b-98371a35f1bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.386s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:32 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:24:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:24:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updating instance_info_cache with network_info: [{"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-95dc4c72-5e91-4666-a31b-037e690c0e6d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:24:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:24:36 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:36 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:24:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYlBCNFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:39 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:39 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:39 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e14eb-783a-499e-95eb-8267dd2833ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:24:39 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248f80d-7959-410a-a7a8-3772a644fdbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4] added
Oct 23 15:24:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a6e76-f119-46f0-97f7-e706df1e65c0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecdf8e2-961c-4cc3-b3c6-d411034c2da7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYlBCNFK {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYlBCNFK" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878d615-2b0e-4283-b5a2-6a3c77dffd45]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gYlBCNFK'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df148d-c22b-4f05-a9b3-c70aab2b74f5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0062dda-f35a-4948-aa16-91126dbf61de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a1bf38-cdb6-4931-bf68-cb6d109875a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260]
Oct 23 15:24:39 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260] successful.
Oct 23 15:24:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc700be-6f0a-4921-bf07-a4f22d099c81]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd3319-d4d3-4406-be3e-39a20c1d5a5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:39 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8abbf6-6d98-46cc-9b2a-6a5d9bbea87d]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYlBCNFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-changed-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Refreshing instance network info cache due to event network-changed-92806353-ba4b-4e20-b238-cf6d08443a8b. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] Acquiring lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] Acquired lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Refreshing network info cache for port 92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26636633266653338', 'path': '/dev/sde'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633266653338', 'path': '/dev/sde'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.objects.instance [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lazy-loading 'flavor' on Instance uuid e28652be-528a-454c-a4d1-2f35474f271a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:24:40 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:24:40 user nova-compute[74421]:   <source dev="/dev/sde"/>
Oct 23 15:24:40 user nova-compute[74421]:   <target dev="sdc" bus="scsi"/>
Oct 23 15:24:40 user nova-compute[74421]:   <serial>7efba4e2-5300-409d-a0e6-44da86522de4</serial>
Oct 23 15:24:40 user nova-compute[74421]:   <address type="drive" controller="0" unit="2"/>
Oct 23 15:24:40 user nova-compute[74421]: </disk>
Oct 23 15:24:40 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updated VIF entry in instance network info cache for port 92806353-ba4b-4e20-b238-cf6d08443a8b. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updating instance_info_cache with network_info: [{"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-154a9bd0-2198-436c-8336-cccece8e24dd req-57962464-11ce-4ca6-b20f-b2a400a240bc service nova] Releasing lock "refresh_cache-46cfd9e6-88d4-48ee-af46-ab81bfcabd23" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:24:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7148MB free_disk=25.353981018066406GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No BDM found with device name sda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] No VIF found with MAC fa:16:3e:c0:70:51, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1c23a9b-3859-4413-b85a-05dbb575f29b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 95dc4c72-5e91-4666-a31b-037e690c0e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e28652be-528a-454c-a4d1-2f35474f271a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 87052596-1511-45a7-9c61-ec1631102126 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance af892fbc-dcf3-4e7b-bfc4-e771919cd5df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 62358513-c579-4486-925b-98371a35f1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:24:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:24:42 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:24:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:24:42 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:24:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:24:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:24:47 user nova-compute[74421]: INFO nova.compute.claims [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Claim successful on node user
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:24:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:24:47 user nova-compute[74421]: DEBUG nova.policy [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '166776dcccda43409673d99af45d4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733f39c7c95492abc827bd581ca7afa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:24:47 user nova-compute[74421]: INFO nova.virt.block_device [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Booting with blank volume at /dev/vda
Oct 23 15:24:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Successfully created port: 13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Successfully updated port: 13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-changed-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Refreshing instance network info cache due to event network-changed-13260e7c-d231-43bd-aa15-f5d4f5f3040e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] Acquiring lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:24:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance network_info: |[{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] Acquired lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG nova.network.neutron [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Refreshing network info cache for port 13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG nova.network.neutron [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updated VIF entry in instance network info cache for port 13260e7c-d231-43bd-aa15-f5d4f5f3040e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG nova.network.neutron [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:24:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c0ecca49-a357-4cc2-955e-f6fb68f1c385 req-de0e40f6-c532-4765-a4c1-fcc34b2c23b3 service nova] Releasing lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:24:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kROanoNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:57 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b374e-0df4-4bb9-a873-4c0ead78016c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:24:57 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e837111-f3fa-4140-a066-f219f08b5727]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135] added
Oct 23 15:24:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ee2c8-c86b-4994-add5-ea53017dec62]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e62689-e548-41b2-8072-fa8886f27b93]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kROanoNl {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kROanoNl" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6966aa67-c838-4d8c-a6b9-a00b4bdcbc75]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kROanoNl'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ecd66-1540-4336-897b-f2915c30daaf]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-24425a42-2190-4081-810b-f50ed0aa7fc7 tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 71.288s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[956cc4ac-50b5-44fd-9c69-318961a37e69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:57 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:57 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:57 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:57 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:57 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:57 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[562118f2-6e1b-4141-a9a0-bea0a84b5d81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260]
Oct 23 15:24:57 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260] successful.
Oct 23 15:24:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[021e9bdb-ca56-48df-89fe-176b84779b23]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-087d503f-a28c-4733-b356-4e421d8c3e6c tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.583s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf15e28-5dc3-43ff-b320-0a0e29183f2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:24:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:58 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:24:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca96c569-484b-4983-87c3-e6639ce43835]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kROanoNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:24:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Creating image(s)
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Ensure instance console log exists: /opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Start _get_guest_xml network_info=[{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '2b3985ee-0505-4d9a-80d7-815a1b53cf98', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQXClwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87052596-1511-45a7-9c61-ec1631102126', 'attached_at': '', 'detached_at': '', 'volume_id': 'd823c542-166b-4a0a-bba8-de97ef0885d8', 'serial': 'd823c542-166b-4a0a-bba8-de97ef0885d8'}, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '42b3b704-61a2-4804-9154-045a6f3121ad', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmpBizhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87052596-1511-45a7-9c61-ec1631102126', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce683976-8617-4a06-b859-9cd386d2951a', 'serial': 'ce683976-8617-4a06-b859-9cd386d2951a'}, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': '616c7008-c709-4fc2-abfd-367156cdc285', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZYyhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87052596-1511-45a7-9c61-ec1631102126', 'attached_at': '', 'detached_at': '', 'volume_id': '4d7321a0-478d-4bb2-81a5-3c226c2eb42d', 'serial': '4d7321a0-478d-4bb2-81a5-3c226c2eb42d'}, 'boot_index': 2, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:24:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:24:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQXClwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:58 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:58 user nova-compute[74421]: INFO nova.compute.manager [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Terminating instance
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PspVMxuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:24:58 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-6e481f45-49d6-4c5b-8c51-f2dfada8eed6 req-d126c552-41f1-4775-b12b-417eaddc5832 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-vif-unplugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6e481f45-49d6-4c5b-8c51-f2dfada8eed6 req-d126c552-41f1-4775-b12b-417eaddc5832 service nova] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6e481f45-49d6-4c5b-8c51-f2dfada8eed6 req-d126c552-41f1-4775-b12b-417eaddc5832 service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6e481f45-49d6-4c5b-8c51-f2dfada8eed6 req-d126c552-41f1-4775-b12b-417eaddc5832 service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-6e481f45-49d6-4c5b-8c51-f2dfada8eed6 req-d126c552-41f1-4775-b12b-417eaddc5832 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] No waiting events found dispatching network-vif-unplugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-6e481f45-49d6-4c5b-8c51-f2dfada8eed6 req-d126c552-41f1-4775-b12b-417eaddc5832 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-vif-unplugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:24:58 user nova-compute[74421]: INFO nova.compute.manager [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Rebuilding instance
Oct 23 15:24:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26566306664386366', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566306664386366', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.844s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:24:59 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.objects.instance [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'flavor' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825503f-3d5a-4c0b-aed4-35b313f012ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:24:59 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4ca9e2-d2ed-4a8c-80bf-1ff33438045f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8] added
Oct 23 15:24:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:24:59 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:24:59 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:24:59 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:24:59 user nova-compute[74421]:   <serial>03a0fa26-7e77-4026-9c2c-3528c5bbc135</serial>
Oct 23 15:24:59 user nova-compute[74421]: </disk>
Oct 23 15:24:59 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c26d09e-2c5e-4a2e-bd75-816ac8c5c367]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce7747e-b6ae-4103-a0ec-54d460e047f8]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQXClwKo {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQXClwKo" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[94318e4c-a87d-44fd-a030-dbbbdd1207a9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQXClwKo'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b2313f-7149-4a6d-8e2f-8cea538b1a94]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5082e2-bccb-4d8d-94f9-cde2dce7e320]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c24f1b3-fe11-4b26-8e63-bab148028fa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260]
Oct 23 15:24:59 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260] successful.
Oct 23 15:24:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17aaae9-bf1c-4650-b500-b71c6947c084]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-41b34f60-2157-4fe7-a5a5-07e36588b90d req-c14bd8e9-d45a-4138-b844-19fb1222bc3a service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-unplugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-41b34f60-2157-4fe7-a5a5-07e36588b90d req-c14bd8e9-d45a-4138-b844-19fb1222bc3a service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-41b34f60-2157-4fe7-a5a5-07e36588b90d req-c14bd8e9-d45a-4138-b844-19fb1222bc3a service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-41b34f60-2157-4fe7-a5a5-07e36588b90d req-c14bd8e9-d45a-4138-b844-19fb1222bc3a service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-41b34f60-2157-4fe7-a5a5-07e36588b90d req-c14bd8e9-d45a-4138-b844-19fb1222bc3a service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-unplugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:24:59 user nova-compute[74421]: WARNING nova.compute.manager [req-41b34f60-2157-4fe7-a5a5-07e36588b90d req-c14bd8e9-d45a-4138-b844-19fb1222bc3a service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-unplugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state active and task_state rebuilding.
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c64be-d0cd-4a42-a065-be51b0234d9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:24:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb54d26-e9a3-4b6d-9c52-e4737f6185bb]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQXClwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:24:59 user nova-compute[74421]: INFO nova.compute.manager [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Detaching volume 7efba4e2-5300-409d-a0e6-44da86522de4
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No BDM found with device name hda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] No VIF found with MAC fa:16:3e:2a:3d:78, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:24:59 user nova-compute[74421]: INFO nova.virt.block_device [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Attempting to driver detach volume 7efba4e2-5300-409d-a0e6-44da86522de4 from mountpoint /dev/sdc
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Attempting to detach device sdc from instance e28652be-528a-454c-a4d1-2f35474f271a from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:24:59 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:24:59 user nova-compute[74421]:   <source dev="/dev/sde"/>
Oct 23 15:24:59 user nova-compute[74421]:   <target dev="sdc" bus="scsi"/>
Oct 23 15:24:59 user nova-compute[74421]:   <serial>7efba4e2-5300-409d-a0e6-44da86522de4</serial>
Oct 23 15:24:59 user nova-compute[74421]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 15:24:59 user nova-compute[74421]: </disk>
Oct 23 15:24:59 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:24:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Successfully detached device sdc from instance e28652be-528a-454c-a4d1-2f35474f271a from the persistent domain config.
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e28652be-528a-454c-a4d1-2f35474f271a from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:24:59 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:24:59 user nova-compute[74421]:   <source dev="/dev/sde"/>
Oct 23 15:24:59 user nova-compute[74421]:   <target dev="sdc" bus="scsi"/>
Oct 23 15:24:59 user nova-compute[74421]:   <serial>7efba4e2-5300-409d-a0e6-44da86522de4</serial>
Oct 23 15:24:59 user nova-compute[74421]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 15:24:59 user nova-compute[74421]: </disk>
Oct 23 15:24:59 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:24:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-87be9835-ad35-45f1-bfa2-2712fe8b97ab tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.143s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e28652be-528a-454c-a4d1-2f35474f271a {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:25:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance destroyed successfully.
Oct 23 15:25:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Instance destroyed successfully.
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lazy-loading 'resources' on Instance uuid d1c23a9b-3859-4413-b85a-05dbb575f29b {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance destroyed successfully.
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1503561539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1799553775',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO75MIGajf4Vw0rXTyRtpSg+qnILL/OJtrCnJSVMDBhv5R1AbedUiPG4/up8ZrSFTDr6ikRP14S05M5xhw0sRohywM06zWPRCpRMWEriANOZNXkKi6kDB6U7/eSItRBg3A==',key_name='tempest-keypair-1846128662',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9f258e8819140888feb117e19e1758b',ramdisk_id='',reservation_id='r-cbzjtcm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-595791159',owner_user_name='tempest-ServerActionsV293TestJSON-595791159-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b95c80b39db4d168440aea6ba214333',uuid=46cfd9e6-88d4-48ee-af46-ab81bfcabd23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converting VIF {"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1368490471',display_name='tempest-DeleteServersTestJSON-server-1368490471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1368490471',id=2,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6cc6b03c90249999ab8c6f3eb605c4a',ramdisk_id='',reservation_id='r-occh805a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1403186658',owner_user_name='tempest-DeleteServersTestJSON-1403186658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:05Z,user_data=None,user_id='b4cdf16d4f324a4dba27657c6c6d4a5c',uuid=d1c23a9b-3859-4413-b85a-05dbb575f29b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Converting VIF {"id": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "address": "fa:16:3e:fa:47:b4", "network": {"id": "be4b66db-0402-45dc-9f26-8fc4ce24aead", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1579921466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6cc6b03c90249999ab8c6f3eb605c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad16d5a-21", "ovs_interfaceid": "1ad16d5a-21ec-4c93-ac44-4dcef9c373fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_vif [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92806353-ba, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad16d5a-21, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa256ac4-6adc-4ca0-9d7b-1512be16cb13) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a578646-63b0-4780-9251-4bcd894583b8) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:00 user nova-compute[74421]: INFO os_vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba')
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:00 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:00 user nova-compute[74421]: INFO os_vif [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:47:b4,bridge_name='br-int',has_traffic_filtering=True,id=1ad16d5a-21ec-4c93-ac44-4dcef9c373fc,network=Network(be4b66db-0402-45dc-9f26-8fc4ce24aead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad16d5a-21')
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmZoLpyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:00 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== connect_volume: return (2282ms) {'type': 'block', 'scsi_wwn': '26135383064623034', 'path': '/dev/sdg'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383064623034', 'path': '/dev/sdg'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.914s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:00 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:00 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1776a9-3c32-46f3-ab72-b837a6ae2e96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:25:00 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmpBizhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:00 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[771bdd09-ebe1-409a-b993-cef6702bcec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169] added
Oct 23 15:25:00 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f2f2c7-d065-44f0-a645-f26710bb993f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ae113-eadc-4ddd-a686-4b057157fc9c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PspVMxuU {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PspVMxuU" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a92dde-5ea8-434b-aced-14930583f92b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PspVMxuU'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df4dd84-5e09-49f4-bd10-cc8e20a6d6d6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[569a4ba9-22bd-430b-9851-36c68cba8580]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1717d1f2-f94f-4163-beda-67cbdba2cbb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260]
Oct 23 15:25:00 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:00 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe5cf1-8813-4086-a091-e9783da33532]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: INFO nova.compute.manager [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Detaching volume 03a0fa26-7e77-4026-9c2c-3528c5bbc135
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f57c442-b01a-422d-9491-8f517c702c7c req-b7b2b8ca-f22f-469c-b2f2-08c23ddcc301 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f57c442-b01a-422d-9491-8f517c702c7c req-b7b2b8ca-f22f-469c-b2f2-08c23ddcc301 service nova] Acquiring lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f57c442-b01a-422d-9491-8f517c702c7c req-b7b2b8ca-f22f-469c-b2f2-08c23ddcc301 service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f57c442-b01a-422d-9491-8f517c702c7c req-b7b2b8ca-f22f-469c-b2f2-08c23ddcc301 service nova] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f57c442-b01a-422d-9491-8f517c702c7c req-b7b2b8ca-f22f-469c-b2f2-08c23ddcc301 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] No waiting events found dispatching network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:00 user nova-compute[74421]: WARNING nova.compute.manager [req-8f57c442-b01a-422d-9491-8f517c702c7c req-b7b2b8ca-f22f-469c-b2f2-08c23ddcc301 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received unexpected event network-vif-plugged-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc for instance with vm_state active and task_state deleting.
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc153c-5cd0-4128-ab50-7f7398ff96fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:00 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb67aaa-c986-4308-a771-b299a45a9df0]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:00 user nova-compute[74421]: INFO nova.virt.block_device [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Attempting to driver detach volume 03a0fa26-7e77-4026-9c2c-3528c5bbc135 from mountpoint /dev/vdb
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Attempting to detach device vdb from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:25:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:00 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:25:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:25:00 user nova-compute[74421]:   <serial>03a0fa26-7e77-4026-9c2c-3528c5bbc135</serial>
Oct 23 15:25:00 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 15:25:00 user nova-compute[74421]: </disk>
Oct 23 15:25:00 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:25:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully detached device vdb from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the persistent domain config.
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:25:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:25:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:00 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:25:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:25:00 user nova-compute[74421]:   <serial>03a0fa26-7e77-4026-9c2c-3528c5bbc135</serial>
Oct 23 15:25:00 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 15:25:00 user nova-compute[74421]: </disk>
Oct 23 15:25:00 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-caf5659e-25c7-46a4-9a84-fc6dc3d4a4d9 req-bc20d332-f880-48b9-9125-09bff5100d83 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-caf5659e-25c7-46a4-9a84-fc6dc3d4a4d9 req-bc20d332-f880-48b9-9125-09bff5100d83 service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-caf5659e-25c7-46a4-9a84-fc6dc3d4a4d9 req-bc20d332-f880-48b9-9125-09bff5100d83 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-caf5659e-25c7-46a4-9a84-fc6dc3d4a4d9 req-bc20d332-f880-48b9-9125-09bff5100d83 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-caf5659e-25c7-46a4-9a84-fc6dc3d4a4d9 req-bc20d332-f880-48b9-9125-09bff5100d83 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:01 user nova-compute[74421]: WARNING nova.compute.manager [req-caf5659e-25c7-46a4-9a84-fc6dc3d4a4d9 req-bc20d332-f880-48b9-9125-09bff5100d83 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state active and task_state rebuilding.
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PspVMxuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] <== connect_volume: return (3295ms) {'type': 'block', 'scsi_wwn': '26133323264633636', 'path': '/dev/sdh'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133323264633636', 'path': '/dev/sdh'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.475s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG nova.objects.instance [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lazy-loading 'flavor' on Instance uuid 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b02a4e9-2c0f-41c5-acd7-2a5b071e3b95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:25:01 user nova-compute[74421]: No targets found.
Oct 23 15:25:01 user nova-compute[74421]: iSNS:
Oct 23 15:25:01 user nova-compute[74421]: No targets found.
Oct 23 15:25:01 user nova-compute[74421]: STATIC:
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135
Oct 23 15:25:01 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:01 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:01 user nova-compute[74421]: FIRMWARE:
Oct 23 15:25:01 user nova-compute[74421]: No targets found.
Oct 23 15:25:01 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:25:01 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:25:01 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0503b505-7b05-4220-a106-c539b5dde7f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] attach device xml: <disk type="block" device="disk">
Oct 23 15:25:01 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:01 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:25:01 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:25:01 user nova-compute[74421]:   <serial>90b425ae-09df-4064-a354-00c9b4d3c169</serial>
Oct 23 15:25:01 user nova-compute[74421]: </disk>
Oct 23 15:25:01 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c1bd1d-b5aa-44ec-9205-f21affb73d8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:01 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24800b32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24847d66-515a-4f37-b234-4b38688d448b]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[148c9a37-7971-442b-837d-fcf461402728]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c06104-34ec-4b85-b9d4-a788820b37d7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfe599f-344a-4691-a4b4-d9882c145af3]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f6394d-d69a-4079-89af-f38e760b1301]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d179b964-41c9-45f7-84f4-d5f6fb8e3dd2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]
Oct 23 15:25:02 user nova-compute[74421]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e1edb5-62e1-421a-a248-8ec31e731181]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== disconnect_volume: return (1804ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:25:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Deleting instance files /opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23_del
Oct 23 15:25:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Deletion of /opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23_del complete
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.811s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ed6629-6763-4b21-b12a-fce8f1ee1bb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:25:02 user nova-compute[74421]: No targets found.
Oct 23 15:25:02 user nova-compute[74421]: iSNS:
Oct 23 15:25:02 user nova-compute[74421]: No targets found.
Oct 23 15:25:02 user nova-compute[74421]: STATIC:
Oct 23 15:25:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:25:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab
Oct 23 15:25:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:25:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4
Oct 23 15:25:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135
Oct 23 15:25:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:02 user nova-compute[74421]: FIRMWARE:
Oct 23 15:25:02 user nova-compute[74421]: No targets found.
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:25:02 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:25:02 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb065cc-4c42-469e-8c09-94cbe89d2042]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b5062-9b6a-43ee-841b-f2331f2348bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2480402200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca67c1b-fe75-4357-b1ce-200d17467c56]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] No VIF found with MAC fa:16:3e:b2:6d:70, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f6ea7-32eb-4905-b8b1-e2d8ecd32e7a]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8806cd-7615-4ceb-8b40-b2ea8e1ff94b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6825199a-97a4-4580-9665-b47fb9194e9a]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5586d61f-b2c0-41fb-a349-6e627f6378d9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 could not be found.
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:02 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7de33966-b0e3-4850-afc3-4daf62f40348 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.092s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[870225a4-2622-4896-ad67-79f63a80a263]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260]
Oct 23 15:25:02 user nova-compute[74421]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39eda0bd-27a2-4466-bc95-bb4ed4f49aab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[286671bd-7d98-41bb-b76a-ef16ba2c4fbd]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] <== disconnect_volume: return (2156ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:25:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Deleting instance files /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b_del
Oct 23 15:25:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Deletion of /opt/stack/data/nova/instances/d1c23a9b-3859-4413-b85a-05dbb575f29b_del complete
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.038s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:02 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:02 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7612ed54-a803-4ca5-b7fd-b9beb48e97a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:25:02 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885f0e2-367b-4b54-af83-b5fff6a6bf36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a] added
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: INFO nova.compute.manager [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Took 4.25 seconds to destroy the instance on the hypervisor.
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db091a1-9681-4d43-8c4a-01663fad523c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab4b87-ef07-40a0-a506-ab23c6a5f95a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmpBizhC {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmpBizhC" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283d048-4065-4ccc-8165-fac27b692d36]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmpBizhC'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[696dda2c-50de-44c6-a461-b4b3447727de]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce7f349-e352-4240-83b3-e68b462a203d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135be54-a041-4333-b683-4a054892f3d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260]
Oct 23 15:25:02 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f761f8d-a494-4a2a-abc7-77e0dd0c1ef0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8915d2c5-4243-45da-8aad-f665d98c4c50]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:02 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ddfc6a-849a-422c-b630-149dde9ee25d]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmpBizhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:03 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Took 0.49 seconds to deallocate network for instance.
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-d2466473-84f7-4b89-a29b-83bf9f537dc1 req-16bc169d-e2b5-4f98-973b-ca999e56ca68 service nova] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Received event network-vif-deleted-1ad16d5a-21ec-4c93-ac44-4dcef9c373fc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.utils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27567d8-c01a-406d-81ea-66b4f1db89a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1e8f7-dbd5-4460-b038-7787d32f9de4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] volume_snapshot_create: create_info: {'snapshot_id': '45f8593b-877f-4fcb-b764-3833824cedb2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74421) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] snap xml: <domainsnapshot>
Oct 23 15:25:03 user nova-compute[74421]:   <disks>
Oct 23 15:25:03 user nova-compute[74421]:     <disk name="/dev/sdh" snapshot="external" type="file">
Oct 23 15:25:03 user nova-compute[74421]:       <source file="/dev/new_file"/>
Oct 23 15:25:03 user nova-compute[74421]:     </disk>
Oct 23 15:25:03 user nova-compute[74421]:     <disk name="vda" snapshot="no"/>
Oct 23 15:25:03 user nova-compute[74421]:   </disks>
Oct 23 15:25:03 user nova-compute[74421]: </domainsnapshot>
Oct 23 15:25:03 user nova-compute[74421]:  {{(pid=74421) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] Lazy-loading 'system_metadata' on Instance uuid 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1b9db1-31c4-4ca8-b381-1fea06335df4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0bf33-6e14-4356-8630-34f9d1751c90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:03 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:25:03 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a721e-5c73-41a8-b240-cc64713e1822]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.utils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating existing volume attachment record: 835af3e0-24ca-4c98-8e2e-ae4da4595114 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     rv = execute(f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     six.reraise(c, e, tb)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     raise value
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     rv = meth(*args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     self._volume_snapshot_create(context, instance, guest,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     rv = execute(f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     six.reraise(c, e, tb)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     raise value
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     rv = meth(*args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] 
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-321c2fcf-197c-422b-b0a1-b12475466667 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] volume_snapshot_delete: delete_info: {'volume_id': '90b425ae-09df-4064-a354-00c9b4d3c169'} {{(pid=74421) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [None req-321c2fcf-197c-422b-b0a1-b12475466667 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9]     if delete_info['type'] != 'qcow2':
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] KeyError: 'type'
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 45f8593b-877f-4fcb-b764-3833824cedb2 could not be found.
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise value
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 45f8593b-877f-4fcb-b764-3833824cedb2 could not be found. (HTTP 404) (Request-ID: req-26a74bfc-e014-45e9-a075-40678553947e)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 45f8593b-877f-4fcb-b764-3833824cedb2 could not be found.
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server [None req-c3f0140a-25fe-4aab-b383-0c5e3579ceb7 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise value
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver [None req-321c2fcf-197c-422b-b0a1-b12475466667 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-18c68266-fd7a-479b-b0ac-ea7865fc663e)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 15:25:03 user nova-compute[74421]: ERROR nova.virt.libvirt.driver 
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server [None req-321c2fcf-197c-422b-b0a1-b12475466667 tempest-VolumesAssistedSnapshotsTest-1286381189 tempest-VolumesAssistedSnapshotsTest-1286381189-project] Exception during message handling: KeyError: 'type'
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 23 15:25:03 user nova-compute[74421]: ERROR oslo_messaging.rpc.server 
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== connect_volume: return (3394ms) {'type': 'block', 'scsi_wwn': '23162353161366331', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162353161366331', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.438s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[907a9445-8f56-4b1a-b73d-8fd03d7400ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:25:04 user nova-compute[74421]: No targets found.
Oct 23 15:25:04 user nova-compute[74421]: iSNS:
Oct 23 15:25:04 user nova-compute[74421]: No targets found.
Oct 23 15:25:04 user nova-compute[74421]: STATIC:
Oct 23 15:25:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:25:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:25:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4
Oct 23 15:25:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:25:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135
Oct 23 15:25:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:04 user nova-compute[74421]: FIRMWARE:
Oct 23 15:25:04 user nova-compute[74421]: No targets found.
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:25:04 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:25:04 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZYyhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:04 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:04 user nova-compute[74421]: INFO nova.compute.manager [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Detaching volume 90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:04 user nova-compute[74421]: INFO nova.compute.manager [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] [instance: d1c23a9b-3859-4413-b85a-05dbb575f29b] Took 0.86 seconds to detach 1 volumes for instance.
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f6e5f3-e165-44e7-8ce1-82a658d3b8a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fe8765-a44b-411f-99f9-41755259688d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24784c4b80>, {}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Disconnecting from: [] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.120s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== disconnect_volume: return (1558ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.088s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:04 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:04 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f47cdd-72d5-4980-b70e-3d84a9ceffdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:25:04 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: INFO nova.virt.block_device [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Attempting to driver detach volume 90b425ae-09df-4064-a354-00c9b4d3c169 from mountpoint /dev/vdb
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Attempting to detach device vdb from instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 15:25:04 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:04 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:25:04 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:25:04 user nova-compute[74421]:   <serial>90b425ae-09df-4064-a354-00c9b4d3c169</serial>
Oct 23 15:25:04 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:25:04 user nova-compute[74421]: </disk>
Oct 23 15:25:04 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:25:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Successfully detached device vdb from instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 from the persistent domain config.
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 15:25:04 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:04 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:25:04 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:25:04 user nova-compute[74421]:   <serial>90b425ae-09df-4064-a354-00c9b4d3c169</serial>
Oct 23 15:25:04 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:25:04 user nova-compute[74421]: </disk>
Oct 23 15:25:04 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5383f9-524b-4784-ab3e-f03e28930813]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d] added
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e9606-69ed-4fdf-bfe2-e0d29595a6b0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[266908dd-31ff-4726-b7f9-1af4ecfdcc4d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOZYyhzx {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOZYyhzx" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7241965-8659-4297-a814-426297268bf6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tOZYyhzx'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5da041-f6df-4127-a728-1c75f4bd1a25]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde05b5b-97a1-49fa-a5a0-1225157670f5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b89d9a-5938-41c9-a244-32e9a312a4e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260]
Oct 23 15:25:04 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e93281-1573-4ed6-a880-f464b655e563]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1ee4c3-69f0-46b6-ae4a-2548d82fe139]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:04 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5527b4-cbe8-40e4-838f-987d6c25d079]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:25:04 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Deleted allocations for instance d1c23a9b-3859-4413-b85a-05dbb575f29b
Oct 23 15:25:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f010ed9-d431-4abe-ae70-faf43828af7d tempest-DeleteServersTestJSON-1403186658 tempest-DeleteServersTestJSON-1403186658-project-member] Lock "d1c23a9b-3859-4413-b85a-05dbb575f29b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.309s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Preparing to wait for external event volume-reimaged-71094d46-9be0-44cb-956e-1779b12eca5f {{(pid=74421) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZYyhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23630383535376162', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630383535376162', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lazy-loading 'pci_devices' on Instance uuid 87052596-1511-45a7-9c61-ec1631102126 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:25:05 user nova-compute[74421]:   <uuid>87052596-1511-45a7-9c61-ec1631102126</uuid>
Oct 23 15:25:05 user nova-compute[74421]:   <name>instance-0000000b</name>
Oct 23 15:25:05 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:25:05 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:25:05 user nova-compute[74421]:   <metadata>
Oct 23 15:25:05 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:05 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:25:05 user nova-compute[74421]:       <nova:name>tempest-device-tagging-server-873486424</nova:name>
Oct 23 15:25:05 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:24:58</nova:creationTime>
Oct 23 15:25:05 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:25:05 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:05 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:25:05 user nova-compute[74421]:       <nova:owner>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:user uuid="17260e98ec464f34a1b55bae41d214c3">tempest-TaggedBootDevicesTest-131439389-project-member</nova:user>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:project uuid="7d8aab7a419a413b95836ec9f86e9a3c">tempest-TaggedBootDevicesTest-131439389</nova:project>
Oct 23 15:25:05 user nova-compute[74421]:       </nova:owner>
Oct 23 15:25:05 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:05 user nova-compute[74421]:       <nova:ports>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="8f1298c0-12d7-4385-8d96-529658cbd8bf">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="1c372a91-7b22-4ec5-8c58-d90c25f64a8f">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="b80e5cc8-6976-44d5-86b4-8ba0a1751053">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="ffb51a57-114d-4445-b91b-bf80fae1e3a3">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="854534dd-636d-4e62-af3d-9fd900fe1d78">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="481adf48-b512-49e3-abd7-e074512d979d">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:         <nova:port uuid="d67be639-fd23-4ae1-b53f-f54208efd988">
Oct 23 15:25:05 user nova-compute[74421]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 15:25:05 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:05 user nova-compute[74421]:       </nova:ports>
Oct 23 15:25:05 user nova-compute[74421]:     </nova:instance>
Oct 23 15:25:05 user nova-compute[74421]:   </metadata>
Oct 23 15:25:05 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:25:05 user nova-compute[74421]:     <system>
Oct 23 15:25:05 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:25:05 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:25:05 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:25:05 user nova-compute[74421]:       <entry name="serial">87052596-1511-45a7-9c61-ec1631102126</entry>
Oct 23 15:25:05 user nova-compute[74421]:       <entry name="uuid">87052596-1511-45a7-9c61-ec1631102126</entry>
Oct 23 15:25:05 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:25:05 user nova-compute[74421]:     </system>
Oct 23 15:25:05 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:05 user nova-compute[74421]:   <os>
Oct 23 15:25:05 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:25:05 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:25:05 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:25:05 user nova-compute[74421]:   </os>
Oct 23 15:25:05 user nova-compute[74421]:   <features>
Oct 23 15:25:05 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:05 user nova-compute[74421]:     <apic/>
Oct 23 15:25:05 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:25:05 user nova-compute[74421]:   </features>
Oct 23 15:25:05 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:25:05 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:25:05 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:25:05 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:25:05 user nova-compute[74421]:   </clock>
Oct 23 15:25:05 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:25:05 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:25:05 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:25:05 user nova-compute[74421]:   </cpu>
Oct 23 15:25:05 user nova-compute[74421]:   <devices>
Oct 23 15:25:05 user nova-compute[74421]:     <disk type="file" device="cdrom">
Oct 23 15:25:05 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 15:25:05 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126/disk.config"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="hda" bus="ide"/>
Oct 23 15:25:05 user nova-compute[74421]:     </disk>
Oct 23 15:25:05 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:25:05 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:05 user nova-compute[74421]:       <source dev="/dev/sdg"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <serial>d823c542-166b-4a0a-bba8-de97ef0885d8</serial>
Oct 23 15:25:05 user nova-compute[74421]:     </disk>
Oct 23 15:25:05 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:25:05 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:05 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <serial>ce683976-8617-4a06-b859-9cd386d2951a</serial>
Oct 23 15:25:05 user nova-compute[74421]:     </disk>
Oct 23 15:25:05 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:25:05 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:05 user nova-compute[74421]:       <source dev="/dev/sdd"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="vdc" bus="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <serial>4d7321a0-478d-4bb2-81a5-3c226c2eb42d</serial>
Oct 23 15:25:05 user nova-compute[74421]:     </disk>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:ea:d7:13"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tap8f1298c0-12"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:b9:90:6c"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tap1c372a91-7b"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:4c:47:86"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tapb80e5cc8-69"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:27:b7:8a"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tapffb51a57-11"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:70:24:ea"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tap854534dd-63"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:76:1d:4b"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tap481adf48-b5"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:05 user nova-compute[74421]:       <mac address="fa:16:3e:d2:7d:7f"/>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:05 user nova-compute[74421]:       <target dev="tapd67be639-fd"/>
Oct 23 15:25:05 user nova-compute[74421]:     </interface>
Oct 23 15:25:05 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:25:05 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126/console.log" append="off"/>
Oct 23 15:25:05 user nova-compute[74421]:     </serial>
Oct 23 15:25:05 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:25:05 user nova-compute[74421]:     <video>
Oct 23 15:25:05 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:05 user nova-compute[74421]:     </video>
Oct 23 15:25:05 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:25:05 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:25:05 user nova-compute[74421]:     </rng>
Oct 23 15:25:05 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:25:05 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:25:05 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:25:05 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:05 user nova-compute[74421]:   </devices>
Oct 23 15:25:05 user nova-compute[74421]: </domain>
Oct 23 15:25:05 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf04f434-3acc-5452-be15-13549115fb02', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1298c0-12, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f1298c0-12, col_values=(('qos', UUID('e96ed981-30ab-40c6-899e-26d9c6b76a67')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f1298c0-12, col_values=(('external_ids', {'iface-id': '8f1298c0-12d7-4385-8d96-529658cbd8bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:d7:13', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12')
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02843923-f5f2-536f-a001-b26c145ac303', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c372a91-7b, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c372a91-7b, col_values=(('qos', UUID('37e89969-3345-43e2-b131-2c5d729e350c')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c372a91-7b, col_values=(('external_ids', {'iface-id': '1c372a91-7b22-4ec5-8c58-d90c25f64a8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:90:6c', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b')
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ade56de-5c53-5c03-a001-c6775e1e2b59', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb80e5cc8-69, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb80e5cc8-69, col_values=(('qos', UUID('f05b7899-f251-40a8-ae60-386ace49751f')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb80e5cc8-69, col_values=(('external_ids', {'iface-id': 'b80e5cc8-6976-44d5-86b4-8ba0a1751053', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:47:86', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69')
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f25170d-0550-52f9-b47f-c39312a10bb5', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffb51a57-11, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffb51a57-11, col_values=(('qos', UUID('5e55068f-9848-49b5-800b-2f688f558268')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffb51a57-11, col_values=(('external_ids', {'iface-id': 'ffb51a57-114d-4445-b91b-bf80fae1e3a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:b7:8a', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11')
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '981d8b65-58c7-5114-9584-5a3c1acb1d0f', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap854534dd-63, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap854534dd-63, col_values=(('qos', UUID('02508948-1973-4046-a5cf-f73320245f2a')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap854534dd-63, col_values=(('external_ids', {'iface-id': '854534dd-636d-4e62-af3d-9fd900fe1d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:24:ea', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63')
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8be890dc-af90-5bb3-8f80-5e4e8213a036', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap481adf48-b5, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap481adf48-b5, col_values=(('qos', UUID('c5be93ea-0b2b-434c-b859-624d8a03c6bf')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap481adf48-b5, col_values=(('external_ids', {'iface-id': '481adf48-b512-49e3-abd7-e074512d979d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:1d:4b', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5')
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '284dd852-3dd2-5196-8a97-4ab6dad9aeb3', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd67be639-fd, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd67be639-fd, col_values=(('qos', UUID('b8ebf1de-54b4-4f71-9163-120ffa6b36d0')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd67be639-fd, col_values=(('external_ids', {'iface-id': 'd67be639-fd23-4ae1-b53f-f54208efd988', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:7d:7f', 'vm-uuid': '87052596-1511-45a7-9c61-ec1631102126'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:06 user nova-compute[74421]: INFO os_vif [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd')
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] No BDM found with device name hda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] No VIF found with MAC fa:16:3e:ea:d7:13, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] No VIF found with MAC fa:16:3e:70:24:ea, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:25:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Using config drive
Oct 23 15:25:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Creating config drive at /opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126/disk.config
Oct 23 15:25:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqu6x4tvh {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqu6x4tvh" returned: 0 in 0.071s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-5b78c670-ac14-40b7-a93a-1c61ec12e796 req-32ecad5a-ce9a-4fcf-a217-991c239ab76e service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5b78c670-ac14-40b7-a93a-1c61ec12e796 req-32ecad5a-ce9a-4fcf-a217-991c239ab76e service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5b78c670-ac14-40b7-a93a-1c61ec12e796 req-32ecad5a-ce9a-4fcf-a217-991c239ab76e service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5b78c670-ac14-40b7-a93a-1c61ec12e796 req-32ecad5a-ce9a-4fcf-a217-991c239ab76e service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-5b78c670-ac14-40b7-a93a-1c61ec12e796 req-32ecad5a-ce9a-4fcf-a217-991c239ab76e service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:08 user nova-compute[74421]: WARNING nova.compute.manager [req-5b78c670-ac14-40b7-a93a-1c61ec12e796 req-32ecad5a-ce9a-4fcf-a217-991c239ab76e service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf for instance with vm_state building and task_state spawning.
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-090cb4b9-9171-43b3-8353-b89fe2d8a720 req-b9f152ba-6fa9-4307-aa6c-114c4143d24d service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-090cb4b9-9171-43b3-8353-b89fe2d8a720 req-b9f152ba-6fa9-4307-aa6c-114c4143d24d service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-090cb4b9-9171-43b3-8353-b89fe2d8a720 req-b9f152ba-6fa9-4307-aa6c-114c4143d24d service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-090cb4b9-9171-43b3-8353-b89fe2d8a720 req-b9f152ba-6fa9-4307-aa6c-114c4143d24d service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-090cb4b9-9171-43b3-8353-b89fe2d8a720 req-b9f152ba-6fa9-4307-aa6c-114c4143d24d service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:08 user nova-compute[74421]: WARNING nova.compute.manager [req-090cb4b9-9171-43b3-8353-b89fe2d8a720 req-b9f152ba-6fa9-4307-aa6c-114c4143d24d service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 for instance with vm_state building and task_state spawning.
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-5d790e2a-c145-49ee-87d0-ebb30e045c88 req-297d9f0d-7f43-4a9f-9a00-2e1bb9ab374b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5d790e2a-c145-49ee-87d0-ebb30e045c88 req-297d9f0d-7f43-4a9f-9a00-2e1bb9ab374b service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5d790e2a-c145-49ee-87d0-ebb30e045c88 req-297d9f0d-7f43-4a9f-9a00-2e1bb9ab374b service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5d790e2a-c145-49ee-87d0-ebb30e045c88 req-297d9f0d-7f43-4a9f-9a00-2e1bb9ab374b service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-5d790e2a-c145-49ee-87d0-ebb30e045c88 req-297d9f0d-7f43-4a9f-9a00-2e1bb9ab374b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:09 user nova-compute[74421]: WARNING nova.compute.manager [req-5d790e2a-c145-49ee-87d0-ebb30e045c88 req-297d9f0d-7f43-4a9f-9a00-2e1bb9ab374b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 for instance with vm_state building and task_state spawning.
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:10 user nova-compute[74421]: WARNING nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf for instance with vm_state building and task_state spawning.
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:10 user nova-compute[74421]: WARNING nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f for instance with vm_state building and task_state spawning.
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:10 user nova-compute[74421]: WARNING nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f for instance with vm_state building and task_state spawning.
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:10 user nova-compute[74421]: WARNING nova.compute.manager [req-7d9e2587-efc6-4318-b81e-9051c97927f1 req-2f45279d-903b-459c-8a30-e2536ef3f36f service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d for instance with vm_state building and task_state spawning.
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:11 user nova-compute[74421]: WARNING nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 for instance with vm_state building and task_state spawning.
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:11 user nova-compute[74421]: WARNING nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 for instance with vm_state building and task_state spawning.
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:11 user nova-compute[74421]: WARNING nova.compute.manager [req-bd8591eb-ed68-4ac1-90a2-eba92de31009 req-3f4d7799-cd98-405b-a2e5-4e3be2bdf9ab service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 for instance with vm_state building and task_state spawning.
Oct 23 15:25:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-8775ff2e-0d77-4de9-ae78-fc186edb4994 req-758673d6-5e65-4b63-bb6a-61ff578f25fa service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8775ff2e-0d77-4de9-ae78-fc186edb4994 req-758673d6-5e65-4b63-bb6a-61ff578f25fa service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8775ff2e-0d77-4de9-ae78-fc186edb4994 req-758673d6-5e65-4b63-bb6a-61ff578f25fa service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8775ff2e-0d77-4de9-ae78-fc186edb4994 req-758673d6-5e65-4b63-bb6a-61ff578f25fa service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-8775ff2e-0d77-4de9-ae78-fc186edb4994 req-758673d6-5e65-4b63-bb6a-61ff578f25fa service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:11 user nova-compute[74421]: WARNING nova.compute.manager [req-8775ff2e-0d77-4de9-ae78-fc186edb4994 req-758673d6-5e65-4b63-bb6a-61ff578f25fa service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 for instance with vm_state building and task_state spawning.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:12 user nova-compute[74421]: WARNING nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d for instance with vm_state building and task_state spawning.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:12 user nova-compute[74421]: WARNING nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 for instance with vm_state building and task_state spawning.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:12 user nova-compute[74421]: WARNING nova.compute.manager [req-86eb7b4f-9763-4554-a243-6cc3f922eb4b req-e5587f4a-7a86-454e-8ee9-e61d8618f086 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 for instance with vm_state building and task_state spawning.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:25:12 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance spawned successfully.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:12 user nova-compute[74421]: INFO nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Took 14.57 seconds to spawn the instance on the hypervisor.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:25:12 user nova-compute[74421]: INFO nova.compute.manager [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Took 113.08 seconds to build instance.
Oct 23 15:25:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b2caca5e-b3db-413d-a124-c4a18dba3a30 tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "87052596-1511-45a7-9c61-ec1631102126" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 113.185s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:16 user nova-compute[74421]: INFO nova.compute.manager [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Terminating instance
Oct 23 15:25:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-33715b25-9d34-4922-a034-5c61b8659c8a req-774fa310-f95b-494e-9d6f-54418b1ea6c0 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-vif-unplugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-33715b25-9d34-4922-a034-5c61b8659c8a req-774fa310-f95b-494e-9d6f-54418b1ea6c0 service nova] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-33715b25-9d34-4922-a034-5c61b8659c8a req-774fa310-f95b-494e-9d6f-54418b1ea6c0 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-33715b25-9d34-4922-a034-5c61b8659c8a req-774fa310-f95b-494e-9d6f-54418b1ea6c0 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-33715b25-9d34-4922-a034-5c61b8659c8a req-774fa310-f95b-494e-9d6f-54418b1ea6c0 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] No waiting events found dispatching network-vif-unplugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-33715b25-9d34-4922-a034-5c61b8659c8a req-774fa310-f95b-494e-9d6f-54418b1ea6c0 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-vif-unplugged-45b650de-ce78-4264-b0ed-c89d9872074a for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:25:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Instance destroyed successfully.
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lazy-loading 'resources' on Instance uuid af892fbc-dcf3-4e7b-bfc4-e771919cd5df {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-516147267',display_name='tempest-ServersNegativeTestJSON-server-516147267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-516147267',id=12,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:23:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab1b4d9c12e94c4fa438af397abcff40',ramdisk_id='',reservation_id='r-10gaweo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-297395355',owner_user_name='tempest-ServersNegativeTestJSON-297395355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:23:34Z,user_data=None,user_id='4ecc4a733599474d926e8feeda4e9328',uuid=af892fbc-dcf3-4e7b-bfc4-e771919cd5df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converting VIF {"id": "45b650de-ce78-4264-b0ed-c89d9872074a", "address": "fa:16:3e:bc:fd:59", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b650de-ce", "ovs_interfaceid": "45b650de-ce78-4264-b0ed-c89d9872074a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG os_vif [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45b650de-ce, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fa6e5de-04b9-4da1-9527-a17b250f5d01) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:17 user nova-compute[74421]: INFO os_vif [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fd:59,bridge_name='br-int',has_traffic_filtering=True,id=45b650de-ce78-4264-b0ed-c89d9872074a,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b650de-ce')
Oct 23 15:25:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Deleting instance files /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df_del
Oct 23 15:25:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Deletion of /opt/stack/data/nova/instances/af892fbc-dcf3-4e7b-bfc4-e771919cd5df_del complete
Oct 23 15:25:17 user nova-compute[74421]: INFO nova.compute.manager [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Took 0.78 seconds to destroy the instance on the hypervisor.
Oct 23 15:25:17 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:17 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Took 0.46 seconds to deallocate network for instance.
Oct 23 15:25:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:18 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:25:18 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:25:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:18 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Deleted allocations for instance af892fbc-dcf3-4e7b-bfc4-e771919cd5df
Oct 23 15:25:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-13f27fd3-0e8f-45ce-b2c0-3ddd5a847771 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] Acquiring lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] Lock "af892fbc-dcf3-4e7b-bfc4-e771919cd5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] No waiting events found dispatching network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:19 user nova-compute[74421]: WARNING nova.compute.manager [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received unexpected event network-vif-plugged-45b650de-ce78-4264-b0ed-c89d9872074a for instance with vm_state deleted and task_state None.
Oct 23 15:25:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-1861f13c-cb01-470b-978d-f93688d11ece req-880ba903-a158-43e2-a641-a831f17eda53 service nova] [instance: af892fbc-dcf3-4e7b-bfc4-e771919cd5df] Received event network-vif-deleted-45b650de-ce78-4264-b0ed-c89d9872074a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:20 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e28652be-528a-454c-a4d1-2f35474f271a is timed out.
Oct 23 15:25:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Successfully detached device sdc from instance e28652be-528a-454c-a4d1-2f35474f271a from the live domain config.
Oct 23 15:25:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYlBCNFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:20 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bed3f8-c066-4b81-8ab9-be7bcda24459]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:25:20 user nova-compute[74421]: No targets found.
Oct 23 15:25:20 user nova-compute[74421]: iSNS:
Oct 23 15:25:20 user nova-compute[74421]: No targets found.
Oct 23 15:25:20 user nova-compute[74421]: STATIC:
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:25:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:20 user nova-compute[74421]: FIRMWARE:
Oct 23 15:25:20 user nova-compute[74421]: No targets found.
Oct 23 15:25:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:25:20 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:25:20 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3d4aa8-d517-41fb-ba69-09e70ec5fd3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76f9dc8-ae69-4588-8eca-e32c7c692321]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:20 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24802b5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4'): ({'sde'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Removing single pathed devices sde {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a51efa-cde1-432b-8342-88706f22e215]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f46b6-d4c8-40f1-b548-8ca49afb4552]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Flushing IO for device /dev/sde {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde02b5-c87a-4b6f-9e0d-f5d68fb8521a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e6f4d-3953-4797-8698-12151025fb2d]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] SCSI volumes sde have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cbf381-fe39-401c-9434-469fd5c44806]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ac31b-3bb7-4ed8-b5aa-2fcf5b8b43a0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260]
Oct 23 15:25:20 user nova-compute[74421]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efba4e2-5300-409d-a0e6-44da86522de4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef26f7a-4bee-4628-9dea-d46285be69db]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] <== disconnect_volume: return (377ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:25:21 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 is timed out.
Oct 23 15:25:21 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully detached device vdb from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the live domain config.
Oct 23 15:25:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kROanoNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:21 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee955e44-dba2-48a1-b114-68600aa0137f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:25:21 user nova-compute[74421]: No targets found.
Oct 23 15:25:21 user nova-compute[74421]: iSNS:
Oct 23 15:25:21 user nova-compute[74421]: No targets found.
Oct 23 15:25:21 user nova-compute[74421]: STATIC:
Oct 23 15:25:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:25:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:25:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:25:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135
Oct 23 15:25:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:25:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:21 user nova-compute[74421]: FIRMWARE:
Oct 23 15:25:21 user nova-compute[74421]: No targets found.
Oct 23 15:25:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:25:21 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:25:21 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[404cf669-eb90-4ec2-a87d-d2e516335816]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[610193a7-4a77-4d20-9ada-7c9d9c055e84]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:21 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782fdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135'): ({'sdf'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Removing single pathed devices sdf {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b90f3b-146c-44f3-baed-a28f0e273e9c]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a98ed39-8098-4126-a619-531ad72fffe1]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Flushing IO for device /dev/sdf {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[740524bb-ee89-4612-980b-377d0e791b26]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146bc3f-4c9f-4492-80d0-393399b34f47]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a3469-1638-4d74-9122-1f2d18d84168]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b801eccf-ba3f-4693-ae86-e5a0149659e2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260]
Oct 23 15:25:21 user nova-compute[74421]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a0fa26-7e77-4026-9c2c-3528c5bbc135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cce5ee-4668-4b22-a9d5-073a8ceb4e8a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] <== disconnect_volume: return (321ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.objects.instance [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'flavor' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3c454e94-8077-4500-9fd7-7db2eb4e9ef2 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "interface-e7724770-32d5-49c0-98d4-a2f2f17f15a8-4011a046-1acf-4911-b4cc-2e40e63dda1e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "interface-e7724770-32d5-49c0-98d4-a2f2f17f15a8-4011a046-1acf-4911-b4cc-2e40e63dda1e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'flavor' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface> {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface> {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Attempting to detach device tap4011a046-1a from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] detach device xml: <interface type="ethernet">
Oct 23 15:25:22 user nova-compute[74421]:   <mac address="fa:16:3e:ca:73:d6"/>
Oct 23 15:25:22 user nova-compute[74421]:   <model type="virtio"/>
Oct 23 15:25:22 user nova-compute[74421]:   <mtu size="1442"/>
Oct 23 15:25:22 user nova-compute[74421]:   <target dev="tap4011a046-1a"/>
Oct 23 15:25:22 user nova-compute[74421]: </interface>
Oct 23 15:25:22 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface> {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 15:25:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 23 15:25:22 user nova-compute[74421]:   <name>instance-00000008</name>
Oct 23 15:25:22 user nova-compute[74421]:   <uuid>e7724770-32d5-49c0-98d4-a2f2f17f15a8</uuid>
Oct 23 15:25:22 user nova-compute[74421]:   <metadata>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:22 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:25:22 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:25:22 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:24:09</nova:creationTime>
Oct 23 15:25:22 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:25:22 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:22 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:25:22 user nova-compute[74421]:   <nova:owner>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:25:22 user nova-compute[74421]:   </nova:owner>
Oct 23 15:25:22 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:22 user nova-compute[74421]:   <nova:ports>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:25:22 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:25:22 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:22 user nova-compute[74421]:     <nova:port uuid="4011a046-1acf-4911-b4cc-2e40e63dda1e">
Oct 23 15:25:22 user nova-compute[74421]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Oct 23 15:25:22 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:22 user nova-compute[74421]:   </nova:ports>
Oct 23 15:25:22 user nova-compute[74421]: </nova:instance>
Oct 23 15:25:22 user nova-compute[74421]:   </metadata>
Oct 23 15:25:22 user nova-compute[74421]:   <memory unit='KiB'>524288</memory>
Oct 23 15:25:22 user nova-compute[74421]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 15:25:22 user nova-compute[74421]:   <vcpu placement='static'>1</vcpu>
Oct 23 15:25:22 user nova-compute[74421]:   <resource>
Oct 23 15:25:22 user nova-compute[74421]:     <partition>/machine</partition>
Oct 23 15:25:22 user nova-compute[74421]:   </resource>
Oct 23 15:25:22 user nova-compute[74421]:   <sysinfo type='smbios'>
Oct 23 15:25:22 user nova-compute[74421]:     <system>
Oct 23 15:25:22 user nova-compute[74421]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 15:25:22 user nova-compute[74421]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 15:25:22 user nova-compute[74421]:       <entry name='version'>0.0.0</entry>
Oct 23 15:25:22 user nova-compute[74421]:       <entry name='serial'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:22 user nova-compute[74421]:       <entry name='uuid'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:22 user nova-compute[74421]:       <entry name='family'>Virtual Machine</entry>
Oct 23 15:25:22 user nova-compute[74421]:     </system>
Oct 23 15:25:22 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:22 user nova-compute[74421]:   <os>
Oct 23 15:25:22 user nova-compute[74421]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 15:25:22 user nova-compute[74421]:     <boot dev='hd'/>
Oct 23 15:25:22 user nova-compute[74421]:     <smbios mode='sysinfo'/>
Oct 23 15:25:22 user nova-compute[74421]:   </os>
Oct 23 15:25:22 user nova-compute[74421]:   <features>
Oct 23 15:25:22 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:22 user nova-compute[74421]:     <apic/>
Oct 23 15:25:22 user nova-compute[74421]:     <vmcoreinfo state='on'/>
Oct 23 15:25:22 user nova-compute[74421]:   </features>
Oct 23 15:25:22 user nova-compute[74421]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 15:25:22 user nova-compute[74421]:     <model fallback='forbid'>Nehalem</model>
Oct 23 15:25:22 user nova-compute[74421]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 15:25:22 user nova-compute[74421]:     <feature policy='require' name='vme'/>
Oct 23 15:25:22 user nova-compute[74421]:     <feature policy='require' name='x2apic'/>
Oct 23 15:25:22 user nova-compute[74421]:     <feature policy='require' name='hypervisor'/>
Oct 23 15:25:22 user nova-compute[74421]:   </cpu>
Oct 23 15:25:22 user nova-compute[74421]:   <clock offset='utc'>
Oct 23 15:25:22 user nova-compute[74421]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 15:25:22 user nova-compute[74421]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 15:25:22 user nova-compute[74421]:     <timer name='hpet' present='no'/>
Oct 23 15:25:22 user nova-compute[74421]:   </clock>
Oct 23 15:25:22 user nova-compute[74421]:   <on_poweroff>destroy</on_poweroff>
Oct 23 15:25:22 user nova-compute[74421]:   <on_reboot>restart</on_reboot>
Oct 23 15:25:22 user nova-compute[74421]:   <on_crash>destroy</on_crash>
Oct 23 15:25:22 user nova-compute[74421]:   <devices>
Oct 23 15:25:22 user nova-compute[74421]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 15:25:22 user nova-compute[74421]:     <disk type='file' device='disk'>
Oct 23 15:25:22 user nova-compute[74421]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 15:25:22 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk' index='2'/>
Oct 23 15:25:22 user nova-compute[74421]:       <backingStore type='file' index='3'>
Oct 23 15:25:22 user nova-compute[74421]:         <format type='raw'/>
Oct 23 15:25:22 user nova-compute[74421]:         <source file='/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee'/>
Oct 23 15:25:22 user nova-compute[74421]:         <backingStore/>
Oct 23 15:25:22 user nova-compute[74421]:       </backingStore>
Oct 23 15:25:22 user nova-compute[74421]:       <target dev='vda' bus='virtio'/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='virtio-disk0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </disk>
Oct 23 15:25:22 user nova-compute[74421]:     <disk type='file' device='cdrom'>
Oct 23 15:25:22 user nova-compute[74421]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 15:25:22 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config' index='1'/>
Oct 23 15:25:22 user nova-compute[74421]:       <backingStore/>
Oct 23 15:25:22 user nova-compute[74421]:       <target dev='hda' bus='ide'/>
Oct 23 15:25:22 user nova-compute[74421]:       <readonly/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='ide0-0-0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </disk>
Oct 23 15:25:22 user nova-compute[74421]:     <controller type='usb' index='0' model='none'>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='usb'/>
Oct 23 15:25:22 user nova-compute[74421]:     </controller>
Oct 23 15:25:22 user nova-compute[74421]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='pci.0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </controller>
Oct 23 15:25:22 user nova-compute[74421]:     <controller type='ide' index='0'>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='ide'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 15:25:22 user nova-compute[74421]:     </controller>
Oct 23 15:25:22 user nova-compute[74421]:     <interface type='ethernet'>
Oct 23 15:25:22 user nova-compute[74421]:       <mac address='fa:16:3e:2a:3d:78'/>
Oct 23 15:25:22 user nova-compute[74421]:       <target dev='tap04f12269-17'/>
Oct 23 15:25:22 user nova-compute[74421]:       <model type='virtio'/>
Oct 23 15:25:22 user nova-compute[74421]:       <mtu size='1442'/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='net0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </interface>
Oct 23 15:25:22 user nova-compute[74421]:     <interface type='ethernet'>
Oct 23 15:25:22 user nova-compute[74421]:       <mac address='fa:16:3e:ca:73:d6'/>
Oct 23 15:25:22 user nova-compute[74421]:       <target dev='tap4011a046-1a'/>
Oct 23 15:25:22 user nova-compute[74421]:       <model type='virtio'/>
Oct 23 15:25:22 user nova-compute[74421]:       <mtu size='1442'/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='net1'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </interface>
Oct 23 15:25:22 user nova-compute[74421]:     <serial type='pty'>
Oct 23 15:25:22 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:22 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:22 user nova-compute[74421]:       <target type='isa-serial' port='0'>
Oct 23 15:25:22 user nova-compute[74421]:         <model name='isa-serial'/>
Oct 23 15:25:22 user nova-compute[74421]:       </target>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </serial>
Oct 23 15:25:22 user nova-compute[74421]:     <console type='pty' tty='/dev/pts/7'>
Oct 23 15:25:22 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:22 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:22 user nova-compute[74421]:       <target type='serial' port='0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </console>
Oct 23 15:25:22 user nova-compute[74421]:     <input type='mouse' bus='ps2'>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='input0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </input>
Oct 23 15:25:22 user nova-compute[74421]:     <input type='keyboard' bus='ps2'>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='input1'/>
Oct 23 15:25:22 user nova-compute[74421]:     </input>
Oct 23 15:25:22 user nova-compute[74421]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 23 15:25:22 user nova-compute[74421]:       <listen type='address' address='0.0.0.0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </graphics>
Oct 23 15:25:22 user nova-compute[74421]:     <audio id='1' type='none'/>
Oct 23 15:25:22 user nova-compute[74421]:     <video>
Oct 23 15:25:22 user nova-compute[74421]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='video0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </video>
Oct 23 15:25:22 user nova-compute[74421]:     <memballoon model='virtio'>
Oct 23 15:25:22 user nova-compute[74421]:       <stats period='10'/>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='balloon0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:22 user nova-compute[74421]:     <rng model='virtio'>
Oct 23 15:25:22 user nova-compute[74421]:       <backend model='random'>/dev/urandom</backend>
Oct 23 15:25:22 user nova-compute[74421]:       <alias name='rng0'/>
Oct 23 15:25:22 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 15:25:22 user nova-compute[74421]:     </rng>
Oct 23 15:25:22 user nova-compute[74421]:   </devices>
Oct 23 15:25:22 user nova-compute[74421]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 15:25:22 user nova-compute[74421]:     <label>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</label>
Oct 23 15:25:22 user nova-compute[74421]:     <imagelabel>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</imagelabel>
Oct 23 15:25:22 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:22 user nova-compute[74421]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 15:25:22 user nova-compute[74421]:     <label>+64055:+108</label>
Oct 23 15:25:22 user nova-compute[74421]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 15:25:22 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:22 user nova-compute[74421]: </domain>
Oct 23 15:25:22 user nova-compute[74421]:  {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 15:25:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully detached device tap4011a046-1a from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the persistent domain config.
Oct 23 15:25:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] (1/8): Attempting to detach device tap4011a046-1a with device alias net1 from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] detach device xml: <interface type="ethernet">
Oct 23 15:25:23 user nova-compute[74421]:   <mac address="fa:16:3e:ca:73:d6"/>
Oct 23 15:25:23 user nova-compute[74421]:   <model type="virtio"/>
Oct 23 15:25:23 user nova-compute[74421]:   <mtu size="1442"/>
Oct 23 15:25:23 user nova-compute[74421]:   <target dev="tap4011a046-1a"/>
Oct 23 15:25:23 user nova-compute[74421]: </interface>
Oct 23 15:25:23 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Start waiting for the detach event from libvirt for device tap4011a046-1a with device alias net1 for instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-66254b9b-ed11-4c9c-9784-da1f9ea751fe req-8314bc58-7de0-422f-9ce9-b5ff5f3c8907 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-unplugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66254b9b-ed11-4c9c-9784-da1f9ea751fe req-8314bc58-7de0-422f-9ce9-b5ff5f3c8907 service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66254b9b-ed11-4c9c-9784-da1f9ea751fe req-8314bc58-7de0-422f-9ce9-b5ff5f3c8907 service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66254b9b-ed11-4c9c-9784-da1f9ea751fe req-8314bc58-7de0-422f-9ce9-b5ff5f3c8907 service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-66254b9b-ed11-4c9c-9784-da1f9ea751fe req-8314bc58-7de0-422f-9ce9-b5ff5f3c8907 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-unplugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:23 user nova-compute[74421]: WARNING nova.compute.manager [req-66254b9b-ed11-4c9c-9784-da1f9ea751fe req-8314bc58-7de0-422f-9ce9-b5ff5f3c8907 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-unplugged-4011a046-1acf-4911-b4cc-2e40e63dda1e for instance with vm_state active and task_state None.
Oct 23 15:25:24 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 is timed out.
Oct 23 15:25:24 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Successfully detached device vdb from instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 from the live domain config.
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PspVMxuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93956d-003a-4a1b-9c08-3e89319871fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:25:24 user nova-compute[74421]: No targets found.
Oct 23 15:25:24 user nova-compute[74421]: iSNS:
Oct 23 15:25:24 user nova-compute[74421]: No targets found.
Oct 23 15:25:24 user nova-compute[74421]: STATIC:
Oct 23 15:25:24 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169
Oct 23 15:25:24 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:24 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:24 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:25:24 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:24 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:24 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:25:24 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:24 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:24 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:25:24 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:24 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:24 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:25:24 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:25:24 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:25:24 user nova-compute[74421]: FIRMWARE:
Oct 23 15:25:24 user nova-compute[74421]: No targets found.
Oct 23 15:25:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:25:24 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:25:24 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e390c902-527c-4f91-ba8f-f34eadb5685b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:25:24 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Creating image(s)
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Ensure instance console log exists: /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Start _get_guest_xml network_info=[{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '835af3e0-24ca-4c98-8e2e-ae4da4595114', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7767aaf1-9958-446c-ba3f-708fddb78750', 'attached_at': '', 'detached_at': '', 'volume_id': '96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'serial': '96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd14d7ce-4060-4ed4-ab79-918b97b74771]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 (non-flash)
Oct 23 15:25:24 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24800b0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169'): ({'sdh'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Removing single pathed devices sdh {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:25:24 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbafea4-08ed-4651-85ba-0d3fae70f20b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[60546261-4211-4f3e-9d82-dac66c3356c5]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Flushing IO for device /dev/sdh {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b526b-1416-4bb2-b3f8-1922dab99708]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb788f-9deb-4bf6-9f70-e4c0d5fe8926]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0e781-7d17-4b07-b18f-ba5daa552546]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef084762-0c74-4639-82d0-6af67bda3abf]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260]
Oct 23 15:25:24 user nova-compute[74421]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b425ae-09df-4064-a354-00c9b4d3c169 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7e2978-1d5c-4b33-b313-4deef351632d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] <== disconnect_volume: return (387ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.217s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:25 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:25 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a661f04-1d69-4b62-98b6-58aab8e78f9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:25:25 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93103b-43e6-444e-ac3a-31b3e9ae23fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4] added
Oct 23 15:25:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a09dc-02d2-4457-a4a4-7d6a62a57400]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c031c8-170d-4733-a9ae-6669342e5fd2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcUpzDew {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcUpzDew" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[060478be-d8af-4c13-973d-a4670589f2e7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcUpzDew'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d845924-7b8a-47ee-9324-7cb774f8cb65]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[634205f4-3b1d-4e2f-a33d-a6a370d07069]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8fa546-d9f2-40de-b11d-b4298e2dca01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260]
Oct 23 15:25:25 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbaa8be-6018-4f08-8bbe-8865222e62aa]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[041751b4-25aa-4076-9a85-b09a9ad60a7e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:25 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f432725f-ba76-4253-8b75-1e35f9b026d0]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG nova.compute.manager [req-25acd464-f9b7-498c-909a-7d75431256e2 req-f6c274b9-dc24-4d2c-8e70-af913408fa76 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25acd464-f9b7-498c-909a-7d75431256e2 req-f6c274b9-dc24-4d2c-8e70-af913408fa76 service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25acd464-f9b7-498c-909a-7d75431256e2 req-f6c274b9-dc24-4d2c-8e70-af913408fa76 service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25acd464-f9b7-498c-909a-7d75431256e2 req-f6c274b9-dc24-4d2c-8e70-af913408fa76 service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG nova.compute.manager [req-25acd464-f9b7-498c-909a-7d75431256e2 req-f6c274b9-dc24-4d2c-8e70-af913408fa76 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:25 user nova-compute[74421]: WARNING nova.compute.manager [req-25acd464-f9b7-498c-909a-7d75431256e2 req-f6c274b9-dc24-4d2c-8e70-af913408fa76 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-plugged-4011a046-1acf-4911-b4cc-2e40e63dda1e for instance with vm_state active and task_state None.
Oct 23 15:25:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lazy-loading 'flavor' on Instance uuid 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lazy-loading 'flavor' on Instance uuid e28652be-528a-454c-a4d1-2f35474f271a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d31c3d5f-044a-49f5-8aef-ac694e1fea25 tempest-VolumesAssistedSnapshotsTest-1460812759 tempest-VolumesAssistedSnapshotsTest-1460812759-project-admin] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.892s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-63f37161-d9a4-42c0-baef-9921255207e3 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.320s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== connect_volume: return (1565ms) {'type': 'block', 'scsi_wwn': '23939346262366532', 'path': '/dev/sde'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939346262366532', 'path': '/dev/sde'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-776177048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-776177048',id=14,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-736t0x06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:24:48Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=7767aaf1-9958-446c-ba3f-708fddb78750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'pci_devices' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:26 user nova-compute[74421]: INFO nova.compute.manager [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Terminating instance
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:25:26 user nova-compute[74421]:   <uuid>7767aaf1-9958-446c-ba3f-708fddb78750</uuid>
Oct 23 15:25:26 user nova-compute[74421]:   <name>instance-0000000e</name>
Oct 23 15:25:26 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:25:26 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:25:26 user nova-compute[74421]:   <metadata>
Oct 23 15:25:26 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:26 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:25:26 user nova-compute[74421]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-776177048</nova:name>
Oct 23 15:25:26 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:25:24</nova:creationTime>
Oct 23 15:25:26 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:25:26 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:26 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:25:26 user nova-compute[74421]:       <nova:owner>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:user uuid="166776dcccda43409673d99af45d4390">tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member</nova:user>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:project uuid="f733f39c7c95492abc827bd581ca7afa">tempest-ServerBootFromVolumeStableRescueTest-2014752681</nova:project>
Oct 23 15:25:26 user nova-compute[74421]:       </nova:owner>
Oct 23 15:25:26 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:26 user nova-compute[74421]:       <nova:ports>
Oct 23 15:25:26 user nova-compute[74421]:         <nova:port uuid="13260e7c-d231-43bd-aa15-f5d4f5f3040e">
Oct 23 15:25:26 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:25:26 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:26 user nova-compute[74421]:       </nova:ports>
Oct 23 15:25:26 user nova-compute[74421]:     </nova:instance>
Oct 23 15:25:26 user nova-compute[74421]:   </metadata>
Oct 23 15:25:26 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:25:26 user nova-compute[74421]:     <system>
Oct 23 15:25:26 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:25:26 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:25:26 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:25:26 user nova-compute[74421]:       <entry name="serial">7767aaf1-9958-446c-ba3f-708fddb78750</entry>
Oct 23 15:25:26 user nova-compute[74421]:       <entry name="uuid">7767aaf1-9958-446c-ba3f-708fddb78750</entry>
Oct 23 15:25:26 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:25:26 user nova-compute[74421]:     </system>
Oct 23 15:25:26 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:26 user nova-compute[74421]:   <os>
Oct 23 15:25:26 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:25:26 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:25:26 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:25:26 user nova-compute[74421]:   </os>
Oct 23 15:25:26 user nova-compute[74421]:   <features>
Oct 23 15:25:26 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:26 user nova-compute[74421]:     <apic/>
Oct 23 15:25:26 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:25:26 user nova-compute[74421]:   </features>
Oct 23 15:25:26 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:25:26 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:25:26 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:25:26 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:25:26 user nova-compute[74421]:   </clock>
Oct 23 15:25:26 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:25:26 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:25:26 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:25:26 user nova-compute[74421]:   </cpu>
Oct 23 15:25:26 user nova-compute[74421]:   <devices>
Oct 23 15:25:26 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:25:26 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:26 user nova-compute[74421]:       <source dev="/dev/sde"/>
Oct 23 15:25:26 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:25:26 user nova-compute[74421]:       <serial>96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4</serial>
Oct 23 15:25:26 user nova-compute[74421]:     </disk>
Oct 23 15:25:26 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:26 user nova-compute[74421]:       <mac address="fa:16:3e:e5:c7:76"/>
Oct 23 15:25:26 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:26 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:26 user nova-compute[74421]:       <target dev="tap13260e7c-d2"/>
Oct 23 15:25:26 user nova-compute[74421]:     </interface>
Oct 23 15:25:26 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:25:26 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/console.log" append="off"/>
Oct 23 15:25:26 user nova-compute[74421]:     </serial>
Oct 23 15:25:26 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:25:26 user nova-compute[74421]:     <video>
Oct 23 15:25:26 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:26 user nova-compute[74421]:     </video>
Oct 23 15:25:26 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:25:26 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:25:26 user nova-compute[74421]:     </rng>
Oct 23 15:25:26 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:25:26 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:25:26 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:25:26 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:26 user nova-compute[74421]:   </devices>
Oct 23 15:25:26 user nova-compute[74421]: </domain>
Oct 23 15:25:26 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-776177048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-776177048',id=14,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-736t0x06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:24:48Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=7767aaf1-9958-446c-ba3f-708fddb78750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG os_vif [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25e86c09-43a9-53fa-b153-0f5aa7cb331c', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13260e7c-d2, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13260e7c-d2, col_values=(('qos', UUID('c44f9d68-7363-4776-b842-17150096caa1')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13260e7c-d2, col_values=(('external_ids', {'iface-id': '13260e7c-d231-43bd-aa15-f5d4f5f3040e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:c7:76', 'vm-uuid': '7767aaf1-9958-446c-ba3f-708fddb78750'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: INFO os_vif [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2')
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No VIF found with MAC fa:16:3e:e5:c7:76, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-fe8236fe-86e6-436a-98cd-002ca34055e8 req-e56276b3-73be-4838-9747-6b53ee5cbb07 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-vif-unplugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fe8236fe-86e6-436a-98cd-002ca34055e8 req-e56276b3-73be-4838-9747-6b53ee5cbb07 service nova] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fe8236fe-86e6-436a-98cd-002ca34055e8 req-e56276b3-73be-4838-9747-6b53ee5cbb07 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fe8236fe-86e6-436a-98cd-002ca34055e8 req-e56276b3-73be-4838-9747-6b53ee5cbb07 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-fe8236fe-86e6-436a-98cd-002ca34055e8 req-e56276b3-73be-4838-9747-6b53ee5cbb07 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] No waiting events found dispatching network-vif-unplugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-fe8236fe-86e6-436a-98cd-002ca34055e8 req-e56276b3-73be-4838-9747-6b53ee5cbb07 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-vif-unplugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:25:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Instance destroyed successfully.
Oct 23 15:25:27 user nova-compute[74421]: DEBUG nova.objects.instance [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lazy-loading 'resources' on Instance uuid e28652be-528a-454c-a4d1-2f35474f271a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1955657409',display_name='tempest-AttachSCSIVolumeTestJSON-server-1955657409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1955657409',id=7,image_ref='1a466289-1768-42e4-8de0-4af670c90069',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdW8r6nbeDNMviTUGyHJgjndFyUiwtayVMah2c5mZPndAgL5SMqoWYIx3oU+00WbM8XMl3MdjBIamkWnmoAnh0zw2+B1sk7TmaeuZc6RuVIsvJTk0Mwd6I8tYZxfzJ/1g==',key_name='tempest-keypair-1896426116',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8111551b98454fbc3cc17bfe05b8f0',ramdisk_id='',reservation_id='r-c84spzdv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a466289-1768-42e4-8de0-4af670c90069',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-313192039',owner_user_name='tempest-AttachSCSIVolumeTestJSON-313192039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70ba86d480f7479d9ce288aca1b1e622',uuid=e28652be-528a-454c-a4d1-2f35474f271a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Converting VIF {"id": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "address": "fa:16:3e:c0:70:51", "network": {"id": "4364d605-f475-4178-ad3b-033fc518f0fc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-222344879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8111551b98454fbc3cc17bfe05b8f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fecdec2-d2", "ovs_interfaceid": "9fecdec2-d2d3-4248-8541-4b96c3b1409a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG os_vif [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fecdec2-d2, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3081c926-9787-4729-a1ba-bdbc0de50789) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:27 user nova-compute[74421]: INFO os_vif [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:51,bridge_name='br-int',has_traffic_filtering=True,id=9fecdec2-d2d3-4248-8541-4b96c3b1409a,network=Network(4364d605-f475-4178-ad3b-033fc518f0fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fecdec2-d2')
Oct 23 15:25:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Deleting instance files /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a_del
Oct 23 15:25:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Deletion of /opt/stack/data/nova/instances/e28652be-528a-454c-a4d1-2f35474f271a_del complete
Oct 23 15:25:27 user nova-compute[74421]: INFO nova.compute.manager [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Took 1.53 seconds to destroy the instance on the hypervisor.
Oct 23 15:25:27 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:25:27 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: e28652be-528a-454c-a4d1-2f35474f271a] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-ba630bf9-89aa-4a37-bb65-d95b57671f29 req-bf46f477-5acc-44c4-9e96-15be82c53e5b service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ba630bf9-89aa-4a37-bb65-d95b57671f29 req-bf46f477-5acc-44c4-9e96-15be82c53e5b service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ba630bf9-89aa-4a37-bb65-d95b57671f29 req-bf46f477-5acc-44c4-9e96-15be82c53e5b service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ba630bf9-89aa-4a37-bb65-d95b57671f29 req-bf46f477-5acc-44c4-9e96-15be82c53e5b service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-ba630bf9-89aa-4a37-bb65-d95b57671f29 req-bf46f477-5acc-44c4-9e96-15be82c53e5b service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:28 user nova-compute[74421]: WARNING nova.compute.manager [req-ba630bf9-89aa-4a37-bb65-d95b57671f29 req-bf46f477-5acc-44c4-9e96-15be82c53e5b service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state building and task_state spawning.
Oct 23 15:25:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-a46e6da9-a69e-4577-af4c-632bcf1e49c5 req-1ff4947f-ec71-45c8-8436-9c5712e03046 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a46e6da9-a69e-4577-af4c-632bcf1e49c5 req-1ff4947f-ec71-45c8-8436-9c5712e03046 service nova] Acquiring lock "e28652be-528a-454c-a4d1-2f35474f271a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a46e6da9-a69e-4577-af4c-632bcf1e49c5 req-1ff4947f-ec71-45c8-8436-9c5712e03046 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a46e6da9-a69e-4577-af4c-632bcf1e49c5 req-1ff4947f-ec71-45c8-8436-9c5712e03046 service nova] Lock "e28652be-528a-454c-a4d1-2f35474f271a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-a46e6da9-a69e-4577-af4c-632bcf1e49c5 req-1ff4947f-ec71-45c8-8436-9c5712e03046 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] No waiting events found dispatching network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:28 user nova-compute[74421]: WARNING nova.compute.manager [req-a46e6da9-a69e-4577-af4c-632bcf1e49c5 req-1ff4947f-ec71-45c8-8436-9c5712e03046 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received unexpected event network-vif-plugged-9fecdec2-d2d3-4248-8541-4b96c3b1409a for instance with vm_state active and task_state deleting.
Oct 23 15:25:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:29 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:29 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Took 1.67 seconds to deallocate network for instance.
Oct 23 15:25:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:30 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Deleted allocations for instance e28652be-528a-454c-a4d1-2f35474f271a
Oct 23 15:25:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-17a70d12-19d5-4c18-b3e6-a5336fb90ef4 tempest-AttachSCSIVolumeTestJSON-313192039 tempest-AttachSCSIVolumeTestJSON-313192039-project-member] Lock "e28652be-528a-454c-a4d1-2f35474f271a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.057s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:25:30 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance spawned successfully.
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:30 user nova-compute[74421]: INFO nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Took 5.98 seconds to spawn the instance on the hypervisor.
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:25:30 user nova-compute[74421]: INFO nova.compute.manager [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Took 43.78 seconds to build instance.
Oct 23 15:25:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6e351f11-bff9-4767-91a3-01adf737fd90 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.893s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:30 user nova-compute[74421]: WARNING nova.compute.manager [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state active and task_state None.
Oct 23 15:25:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-fd3ed458-c3f1-4c07-a4f9-70bccc38d36d req-15d62a8c-4200-4cfc-989f-1283c3b68423 service nova] [instance: e28652be-528a-454c-a4d1-2f35474f271a] Received event network-vif-deleted-9fecdec2-d2d3-4248-8541-4b96c3b1409a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:32 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:25:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:32 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:25:32 user nova-compute[74421]: INFO nova.compute.claims [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Claim successful on node user
Oct 23 15:25:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:25:33 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.policy [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182146bec4cf473ab9e025bca5a74371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0053dc54a1e44f18966d687a2bb42e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:25:33 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Creating image(s)
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk 1073741824" returned: 0 in 0.048s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Successfully created port: 05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:25:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Cannot resize image /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Ensure instance console log exists: /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Successfully updated port: 05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquired lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-changed-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Refreshing instance network info cache due to event network-changed-05470b57-eedc-49e7-b83d-6ae2db174534. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] Acquiring lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:25:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updating instance_info_cache with network_info: [{"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Releasing lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance network_info: |[{"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] Acquired lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Refreshing network info cache for port 05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Start _get_guest_xml network_info=[{"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:25:35 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:25:35 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-506788264',display_name='tempest-tempest.common.compute-instance-506788264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-506788264',id=15,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmW0O5aoiaZpMBDkAmf3an82vwxyINqA/CDwM1m4iutk0cJWpJOWhGgGr5W1axIpB/Fe6m00qmB62wc7PmAYE80M80+8qw8gMXJmRIeUGjn5QOJH0K4N/UF1rhqizfqmg==',key_name='tempest-keypair-1144591236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-y0tfs0mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=0879f788-a600-4bfe-b858-deec2a8b1a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.objects.instance [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'pci_devices' on Instance uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:25:35 user nova-compute[74421]:   <uuid>0879f788-a600-4bfe-b858-deec2a8b1a51</uuid>
Oct 23 15:25:35 user nova-compute[74421]:   <name>instance-0000000f</name>
Oct 23 15:25:35 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:25:35 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:25:35 user nova-compute[74421]:   <metadata>
Oct 23 15:25:35 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:35 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:25:35 user nova-compute[74421]:       <nova:name>tempest-tempest.common.compute-instance-506788264</nova:name>
Oct 23 15:25:35 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:25:35</nova:creationTime>
Oct 23 15:25:35 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:25:35 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:35 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:25:35 user nova-compute[74421]:       <nova:owner>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:user uuid="182146bec4cf473ab9e025bca5a74371">tempest-ServerActionsTestOtherA-369604222-project-member</nova:user>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:project uuid="d0053dc54a1e44f18966d687a2bb42e4">tempest-ServerActionsTestOtherA-369604222</nova:project>
Oct 23 15:25:35 user nova-compute[74421]:       </nova:owner>
Oct 23 15:25:35 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:35 user nova-compute[74421]:       <nova:ports>
Oct 23 15:25:35 user nova-compute[74421]:         <nova:port uuid="05470b57-eedc-49e7-b83d-6ae2db174534">
Oct 23 15:25:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:25:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:35 user nova-compute[74421]:       </nova:ports>
Oct 23 15:25:35 user nova-compute[74421]:     </nova:instance>
Oct 23 15:25:35 user nova-compute[74421]:   </metadata>
Oct 23 15:25:35 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:25:35 user nova-compute[74421]:     <system>
Oct 23 15:25:35 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:25:35 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:25:35 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:25:35 user nova-compute[74421]:       <entry name="serial">0879f788-a600-4bfe-b858-deec2a8b1a51</entry>
Oct 23 15:25:35 user nova-compute[74421]:       <entry name="uuid">0879f788-a600-4bfe-b858-deec2a8b1a51</entry>
Oct 23 15:25:35 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:25:35 user nova-compute[74421]:     </system>
Oct 23 15:25:35 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:35 user nova-compute[74421]:   <os>
Oct 23 15:25:35 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:25:35 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:25:35 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:25:35 user nova-compute[74421]:   </os>
Oct 23 15:25:35 user nova-compute[74421]:   <features>
Oct 23 15:25:35 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:35 user nova-compute[74421]:     <apic/>
Oct 23 15:25:35 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:25:35 user nova-compute[74421]:   </features>
Oct 23 15:25:35 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:25:35 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:25:35 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:25:35 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:25:35 user nova-compute[74421]:   </clock>
Oct 23 15:25:35 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:25:35 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:25:35 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:25:35 user nova-compute[74421]:   </cpu>
Oct 23 15:25:35 user nova-compute[74421]:   <devices>
Oct 23 15:25:35 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:25:35 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:25:35 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk"/>
Oct 23 15:25:35 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:25:35 user nova-compute[74421]:     </disk>
Oct 23 15:25:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:35 user nova-compute[74421]:       <mac address="fa:16:3e:10:bf:ea"/>
Oct 23 15:25:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:35 user nova-compute[74421]:       <target dev="tap05470b57-ee"/>
Oct 23 15:25:35 user nova-compute[74421]:     </interface>
Oct 23 15:25:35 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:25:35 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/console.log" append="off"/>
Oct 23 15:25:35 user nova-compute[74421]:     </serial>
Oct 23 15:25:35 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:25:35 user nova-compute[74421]:     <video>
Oct 23 15:25:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:35 user nova-compute[74421]:     </video>
Oct 23 15:25:35 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:25:35 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:25:35 user nova-compute[74421]:     </rng>
Oct 23 15:25:35 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:25:35 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:25:35 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:25:35 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:35 user nova-compute[74421]:   </devices>
Oct 23 15:25:35 user nova-compute[74421]: </domain>
Oct 23 15:25:35 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-506788264',display_name='tempest-tempest.common.compute-instance-506788264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-506788264',id=15,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmW0O5aoiaZpMBDkAmf3an82vwxyINqA/CDwM1m4iutk0cJWpJOWhGgGr5W1axIpB/Fe6m00qmB62wc7PmAYE80M80+8qw8gMXJmRIeUGjn5QOJH0K4N/UF1rhqizfqmg==',key_name='tempest-keypair-1144591236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-y0tfs0mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=0879f788-a600-4bfe-b858-deec2a8b1a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG os_vif [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f86e9048-b621-5f41-9b94-c584e4fb6faf', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05470b57-ee, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05470b57-ee, col_values=(('qos', UUID('a1b9c179-c642-438f-aaca-b10a71df9fac')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05470b57-ee, col_values=(('external_ids', {'iface-id': '05470b57-eedc-49e7-b83d-6ae2db174534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:bf:ea', 'vm-uuid': '0879f788-a600-4bfe-b858-deec2a8b1a51'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:35 user nova-compute[74421]: INFO os_vif [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee')
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No VIF found with MAC fa:16:3e:10:bf:ea, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updated VIF entry in instance network info cache for port 05470b57-eedc-49e7-b83d-6ae2db174534. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updating instance_info_cache with network_info: [{"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b62e1b64-d382-46fc-80a6-5def34ccbfbe req-5c2956b6-1b38-4e3d-badb-502e8b327b4a service nova] Releasing lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-69097cc6-ea27-490c-86bf-8fbf1ed7a9ce req-6d5adecc-bc2e-4e68-aa28-1240218cb6e2 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-69097cc6-ea27-490c-86bf-8fbf1ed7a9ce req-6d5adecc-bc2e-4e68-aa28-1240218cb6e2 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-69097cc6-ea27-490c-86bf-8fbf1ed7a9ce req-6d5adecc-bc2e-4e68-aa28-1240218cb6e2 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-69097cc6-ea27-490c-86bf-8fbf1ed7a9ce req-6d5adecc-bc2e-4e68-aa28-1240218cb6e2 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-69097cc6-ea27-490c-86bf-8fbf1ed7a9ce req-6d5adecc-bc2e-4e68-aa28-1240218cb6e2 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:37 user nova-compute[74421]: WARNING nova.compute.manager [req-69097cc6-ea27-490c-86bf-8fbf1ed7a9ce req-6d5adecc-bc2e-4e68-aa28-1240218cb6e2 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state building and task_state spawning.
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'flavor' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-d0c99eda-c72a-43e4-82c8-de702361c9f2 req-86841deb-6d51-45e5-b09c-5ae323432e35 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event volume-reimaged-71094d46-9be0-44cb-956e-1779b12eca5f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d0c99eda-c72a-43e4-82c8-de702361c9f2 req-86841deb-6d51-45e5-b09c-5ae323432e35 service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d0c99eda-c72a-43e4-82c8-de702361c9f2 req-86841deb-6d51-45e5-b09c-5ae323432e35 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d0c99eda-c72a-43e4-82c8-de702361c9f2 req-86841deb-6d51-45e5-b09c-5ae323432e35 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-d0c99eda-c72a-43e4-82c8-de702361c9f2 req-86841deb-6d51-45e5-b09c-5ae323432e35 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Processing event volume-reimaged-71094d46-9be0-44cb-956e-1779b12eca5f {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance event wait completed in 32 seconds for volume-reimaged {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:37 user nova-compute[74421]: INFO nova.virt.block_device [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Booting with volume 71094d46-9be0-44cb-956e-1779b12eca5f at /dev/vda
Oct 23 15:25:37 user nova-compute[74421]: DEBUG os_brick.utils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcf6d21-e3fe-4d0b-951f-f9bb9b1681b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382395f-c77a-4e3a-af77-0075541f68e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:37 user nova-compute[74421]: INFO nova.compute.manager [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Attaching volume 1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 to /dev/vdb
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb0d965-e43c-42a4-9075-af1435c6d7b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab1ce7c-d8df-4024-a50f-16fa0362c191]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:25:38 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c00670-f127-4339-8dde-8c68cd89abf3]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.utils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updating existing volume attachment record: 14a1c2a9-b6d3-42ff-a464-70b186da9dfe {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.utils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825f8dc-55d2-40ac-93bc-eeca567571d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b1d0b9-5e3b-4394-87c4-ed5f25107b79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b72d0-0c5a-4407-9140-c6caae7374e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ccef7c-528a-417d-a02a-013c21d6da32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:25:38 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7362c19c-abd3-4db5-ab55-040454843c13]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG os_brick.utils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating existing volume attachment record: 8c56876a-4359-4ac9-b6e3-df5fab561c3a {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:25:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:25:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance spawned successfully.
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-8ce5429b-3428-450e-8fa3-79bd9e4d69c2 req-a954882c-7d3c-4166-b7ee-e8ccab7eb718 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8ce5429b-3428-450e-8fa3-79bd9e4d69c2 req-a954882c-7d3c-4166-b7ee-e8ccab7eb718 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8ce5429b-3428-450e-8fa3-79bd9e4d69c2 req-a954882c-7d3c-4166-b7ee-e8ccab7eb718 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8ce5429b-3428-450e-8fa3-79bd9e4d69c2 req-a954882c-7d3c-4166-b7ee-e8ccab7eb718 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-8ce5429b-3428-450e-8fa3-79bd9e4d69c2 req-a954882c-7d3c-4166-b7ee-e8ccab7eb718 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:25:39 user nova-compute[74421]: WARNING nova.compute.manager [req-8ce5429b-3428-450e-8fa3-79bd9e4d69c2 req-a954882c-7d3c-4166-b7ee-e8ccab7eb718 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state building and task_state spawning.
Oct 23 15:25:39 user nova-compute[74421]: INFO nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:39 user nova-compute[74421]: INFO nova.compute.manager [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Took 7.14 seconds to build instance.
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-03495e37-5fc4-46d3-b649-abebf4fdb881 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.348s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:25:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:43 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Waiting for libvirt event about the detach of device tap4011a046-1a with device alias net1 from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 is timed out.
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface> {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 23 15:25:43 user nova-compute[74421]:   <name>instance-00000008</name>
Oct 23 15:25:43 user nova-compute[74421]:   <uuid>e7724770-32d5-49c0-98d4-a2f2f17f15a8</uuid>
Oct 23 15:25:43 user nova-compute[74421]:   <metadata>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:43 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:24:09</nova:creationTime>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:25:43 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:43 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:owner>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:25:43 user nova-compute[74421]:   </nova:owner>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:ports>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:25:43 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:25:43 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:port uuid="4011a046-1acf-4911-b4cc-2e40e63dda1e">
Oct 23 15:25:43 user nova-compute[74421]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Oct 23 15:25:43 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:43 user nova-compute[74421]:   </nova:ports>
Oct 23 15:25:43 user nova-compute[74421]: </nova:instance>
Oct 23 15:25:43 user nova-compute[74421]:   </metadata>
Oct 23 15:25:43 user nova-compute[74421]:   <memory unit='KiB'>524288</memory>
Oct 23 15:25:43 user nova-compute[74421]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 15:25:43 user nova-compute[74421]:   <vcpu placement='static'>1</vcpu>
Oct 23 15:25:43 user nova-compute[74421]:   <resource>
Oct 23 15:25:43 user nova-compute[74421]:     <partition>/machine</partition>
Oct 23 15:25:43 user nova-compute[74421]:   </resource>
Oct 23 15:25:43 user nova-compute[74421]:   <sysinfo type='smbios'>
Oct 23 15:25:43 user nova-compute[74421]:     <system>
Oct 23 15:25:43 user nova-compute[74421]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 15:25:43 user nova-compute[74421]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 15:25:43 user nova-compute[74421]:       <entry name='version'>0.0.0</entry>
Oct 23 15:25:43 user nova-compute[74421]:       <entry name='serial'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:43 user nova-compute[74421]:       <entry name='uuid'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:43 user nova-compute[74421]:       <entry name='family'>Virtual Machine</entry>
Oct 23 15:25:43 user nova-compute[74421]:     </system>
Oct 23 15:25:43 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:43 user nova-compute[74421]:   <os>
Oct 23 15:25:43 user nova-compute[74421]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 15:25:43 user nova-compute[74421]:     <boot dev='hd'/>
Oct 23 15:25:43 user nova-compute[74421]:     <smbios mode='sysinfo'/>
Oct 23 15:25:43 user nova-compute[74421]:   </os>
Oct 23 15:25:43 user nova-compute[74421]:   <features>
Oct 23 15:25:43 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:43 user nova-compute[74421]:     <apic/>
Oct 23 15:25:43 user nova-compute[74421]:     <vmcoreinfo state='on'/>
Oct 23 15:25:43 user nova-compute[74421]:   </features>
Oct 23 15:25:43 user nova-compute[74421]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 15:25:43 user nova-compute[74421]:     <model fallback='forbid'>Nehalem</model>
Oct 23 15:25:43 user nova-compute[74421]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 15:25:43 user nova-compute[74421]:     <feature policy='require' name='vme'/>
Oct 23 15:25:43 user nova-compute[74421]:     <feature policy='require' name='x2apic'/>
Oct 23 15:25:43 user nova-compute[74421]:     <feature policy='require' name='hypervisor'/>
Oct 23 15:25:43 user nova-compute[74421]:   </cpu>
Oct 23 15:25:43 user nova-compute[74421]:   <clock offset='utc'>
Oct 23 15:25:43 user nova-compute[74421]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 15:25:43 user nova-compute[74421]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 15:25:43 user nova-compute[74421]:     <timer name='hpet' present='no'/>
Oct 23 15:25:43 user nova-compute[74421]:   </clock>
Oct 23 15:25:43 user nova-compute[74421]:   <on_poweroff>destroy</on_poweroff>
Oct 23 15:25:43 user nova-compute[74421]:   <on_reboot>restart</on_reboot>
Oct 23 15:25:43 user nova-compute[74421]:   <on_crash>destroy</on_crash>
Oct 23 15:25:43 user nova-compute[74421]:   <devices>
Oct 23 15:25:43 user nova-compute[74421]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 15:25:43 user nova-compute[74421]:     <disk type='file' device='disk'>
Oct 23 15:25:43 user nova-compute[74421]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 15:25:43 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk' index='2'/>
Oct 23 15:25:43 user nova-compute[74421]:       <backingStore type='file' index='3'>
Oct 23 15:25:43 user nova-compute[74421]:         <format type='raw'/>
Oct 23 15:25:43 user nova-compute[74421]:         <source file='/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee'/>
Oct 23 15:25:43 user nova-compute[74421]:         <backingStore/>
Oct 23 15:25:43 user nova-compute[74421]:       </backingStore>
Oct 23 15:25:43 user nova-compute[74421]:       <target dev='vda' bus='virtio'/>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='virtio-disk0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </disk>
Oct 23 15:25:43 user nova-compute[74421]:     <disk type='file' device='cdrom'>
Oct 23 15:25:43 user nova-compute[74421]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 15:25:43 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config' index='1'/>
Oct 23 15:25:43 user nova-compute[74421]:       <backingStore/>
Oct 23 15:25:43 user nova-compute[74421]:       <target dev='hda' bus='ide'/>
Oct 23 15:25:43 user nova-compute[74421]:       <readonly/>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='ide0-0-0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </disk>
Oct 23 15:25:43 user nova-compute[74421]:     <controller type='usb' index='0' model='none'>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='usb'/>
Oct 23 15:25:43 user nova-compute[74421]:     </controller>
Oct 23 15:25:43 user nova-compute[74421]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='pci.0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </controller>
Oct 23 15:25:43 user nova-compute[74421]:     <controller type='ide' index='0'>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='ide'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 15:25:43 user nova-compute[74421]:     </controller>
Oct 23 15:25:43 user nova-compute[74421]:     <interface type='ethernet'>
Oct 23 15:25:43 user nova-compute[74421]:       <mac address='fa:16:3e:2a:3d:78'/>
Oct 23 15:25:43 user nova-compute[74421]:       <target dev='tap04f12269-17'/>
Oct 23 15:25:43 user nova-compute[74421]:       <model type='virtio'/>
Oct 23 15:25:43 user nova-compute[74421]:       <mtu size='1442'/>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='net0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </interface>
Oct 23 15:25:43 user nova-compute[74421]:     <serial type='pty'>
Oct 23 15:25:43 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:43 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:43 user nova-compute[74421]:       <target type='isa-serial' port='0'>
Oct 23 15:25:43 user nova-compute[74421]:         <model name='isa-serial'/>
Oct 23 15:25:43 user nova-compute[74421]:       </target>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </serial>
Oct 23 15:25:43 user nova-compute[74421]:     <console type='pty' tty='/dev/pts/7'>
Oct 23 15:25:43 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:43 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:43 user nova-compute[74421]:       <target type='serial' port='0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </console>
Oct 23 15:25:43 user nova-compute[74421]:     <input type='mouse' bus='ps2'>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='input0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </input>
Oct 23 15:25:43 user nova-compute[74421]:     <input type='keyboard' bus='ps2'>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='input1'/>
Oct 23 15:25:43 user nova-compute[74421]:     </input>
Oct 23 15:25:43 user nova-compute[74421]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 23 15:25:43 user nova-compute[74421]:       <listen type='address' address='0.0.0.0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </graphics>
Oct 23 15:25:43 user nova-compute[74421]:     <audio id='1' type='none'/>
Oct 23 15:25:43 user nova-compute[74421]:     <video>
Oct 23 15:25:43 user nova-compute[74421]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='video0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </video>
Oct 23 15:25:43 user nova-compute[74421]:     <memballoon model='virtio'>
Oct 23 15:25:43 user nova-compute[74421]:       <stats period='10'/>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='balloon0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:43 user nova-compute[74421]:     <rng model='virtio'>
Oct 23 15:25:43 user nova-compute[74421]:       <backend model='random'>/dev/urandom</backend>
Oct 23 15:25:43 user nova-compute[74421]:       <alias name='rng0'/>
Oct 23 15:25:43 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 15:25:43 user nova-compute[74421]:     </rng>
Oct 23 15:25:43 user nova-compute[74421]:   </devices>
Oct 23 15:25:43 user nova-compute[74421]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 15:25:43 user nova-compute[74421]:     <label>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</label>
Oct 23 15:25:43 user nova-compute[74421]:     <imagelabel>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</imagelabel>
Oct 23 15:25:43 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:43 user nova-compute[74421]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 15:25:43 user nova-compute[74421]:     <label>+64055:+108</label>
Oct 23 15:25:43 user nova-compute[74421]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 15:25:43 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:43 user nova-compute[74421]: </domain>
Oct 23 15:25:43 user nova-compute[74421]:  {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 15:25:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully detached device tap4011a046-1a from instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 from the live domain config.
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG os_vif [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:25:43 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:25:43 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7574MB free_disk=25.386920928955078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4011a046-1a, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c08020ee-0499-4e09-bdf3-2e9dfe080a80) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:43 user nova-compute[74421]: INFO os_vif [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a')
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:43 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:25:43</nova:creationTime>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:25:43 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:43 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:owner>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:25:43 user nova-compute[74421]:   </nova:owner>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:43 user nova-compute[74421]:   <nova:ports>
Oct 23 15:25:43 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:25:43 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:25:43 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:43 user nova-compute[74421]:   </nova:ports>
Oct 23 15:25:43 user nova-compute[74421]: </nova:instance>
Oct 23 15:25:43 user nova-compute[74421]:  {{(pid=74421) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 95dc4c72-5e91-4666-a31b-037e690c0e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance e7724770-32d5-49c0-98d4-a2f2f17f15a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 87052596-1511-45a7-9c61-ec1631102126 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 62358513-c579-4486-925b-98371a35f1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:25:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-deleted-4011a046-1acf-4911-b4cc-2e40e63dda1e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:25:44 user nova-compute[74421]: INFO nova.compute.manager [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Neutron deleted interface 4011a046-1acf-4911-b4cc-2e40e63dda1e; detaching it from the instance and deleting it from the info cache
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.neutron [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.objects.instance [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Lazy-loading 'system_metadata' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquired lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.objects.instance [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Lazy-loading 'flavor' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.objects.base [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Object Instance<e7724770-32d5-49c0-98d4-a2f2f17f15a8> lazy-loaded attributes: system_metadata,flavor {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Converting VIF {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface> {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 23 15:25:44 user nova-compute[74421]:   <name>instance-00000008</name>
Oct 23 15:25:44 user nova-compute[74421]:   <uuid>e7724770-32d5-49c0-98d4-a2f2f17f15a8</uuid>
Oct 23 15:25:44 user nova-compute[74421]:   <metadata>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:44 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:25:43</nova:creationTime>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:25:44 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:owner>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:owner>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:ports>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:25:44 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:25:44 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:ports>
Oct 23 15:25:44 user nova-compute[74421]: </nova:instance>
Oct 23 15:25:44 user nova-compute[74421]:   </metadata>
Oct 23 15:25:44 user nova-compute[74421]:   <memory unit='KiB'>524288</memory>
Oct 23 15:25:44 user nova-compute[74421]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 15:25:44 user nova-compute[74421]:   <vcpu placement='static'>1</vcpu>
Oct 23 15:25:44 user nova-compute[74421]:   <resource>
Oct 23 15:25:44 user nova-compute[74421]:     <partition>/machine</partition>
Oct 23 15:25:44 user nova-compute[74421]:   </resource>
Oct 23 15:25:44 user nova-compute[74421]:   <sysinfo type='smbios'>
Oct 23 15:25:44 user nova-compute[74421]:     <system>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='version'>0.0.0</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='serial'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='uuid'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='family'>Virtual Machine</entry>
Oct 23 15:25:44 user nova-compute[74421]:     </system>
Oct 23 15:25:44 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:44 user nova-compute[74421]:   <os>
Oct 23 15:25:44 user nova-compute[74421]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 15:25:44 user nova-compute[74421]:     <boot dev='hd'/>
Oct 23 15:25:44 user nova-compute[74421]:     <smbios mode='sysinfo'/>
Oct 23 15:25:44 user nova-compute[74421]:   </os>
Oct 23 15:25:44 user nova-compute[74421]:   <features>
Oct 23 15:25:44 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:44 user nova-compute[74421]:     <apic/>
Oct 23 15:25:44 user nova-compute[74421]:     <vmcoreinfo state='on'/>
Oct 23 15:25:44 user nova-compute[74421]:   </features>
Oct 23 15:25:44 user nova-compute[74421]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 15:25:44 user nova-compute[74421]:     <model fallback='forbid'>Nehalem</model>
Oct 23 15:25:44 user nova-compute[74421]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 15:25:44 user nova-compute[74421]:     <feature policy='require' name='vme'/>
Oct 23 15:25:44 user nova-compute[74421]:     <feature policy='require' name='x2apic'/>
Oct 23 15:25:44 user nova-compute[74421]:     <feature policy='require' name='hypervisor'/>
Oct 23 15:25:44 user nova-compute[74421]:   </cpu>
Oct 23 15:25:44 user nova-compute[74421]:   <clock offset='utc'>
Oct 23 15:25:44 user nova-compute[74421]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 15:25:44 user nova-compute[74421]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 15:25:44 user nova-compute[74421]:     <timer name='hpet' present='no'/>
Oct 23 15:25:44 user nova-compute[74421]:   </clock>
Oct 23 15:25:44 user nova-compute[74421]:   <on_poweroff>destroy</on_poweroff>
Oct 23 15:25:44 user nova-compute[74421]:   <on_reboot>restart</on_reboot>
Oct 23 15:25:44 user nova-compute[74421]:   <on_crash>destroy</on_crash>
Oct 23 15:25:44 user nova-compute[74421]:   <devices>
Oct 23 15:25:44 user nova-compute[74421]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 15:25:44 user nova-compute[74421]:     <disk type='file' device='disk'>
Oct 23 15:25:44 user nova-compute[74421]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 15:25:44 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk' index='2'/>
Oct 23 15:25:44 user nova-compute[74421]:       <backingStore type='file' index='3'>
Oct 23 15:25:44 user nova-compute[74421]:         <format type='raw'/>
Oct 23 15:25:44 user nova-compute[74421]:         <source file='/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee'/>
Oct 23 15:25:44 user nova-compute[74421]:         <backingStore/>
Oct 23 15:25:44 user nova-compute[74421]:       </backingStore>
Oct 23 15:25:44 user nova-compute[74421]:       <target dev='vda' bus='virtio'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='virtio-disk0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </disk>
Oct 23 15:25:44 user nova-compute[74421]:     <disk type='file' device='cdrom'>
Oct 23 15:25:44 user nova-compute[74421]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 15:25:44 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config' index='1'/>
Oct 23 15:25:44 user nova-compute[74421]:       <backingStore/>
Oct 23 15:25:44 user nova-compute[74421]:       <target dev='hda' bus='ide'/>
Oct 23 15:25:44 user nova-compute[74421]:       <readonly/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='ide0-0-0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </disk>
Oct 23 15:25:44 user nova-compute[74421]:     <controller type='usb' index='0' model='none'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='usb'/>
Oct 23 15:25:44 user nova-compute[74421]:     </controller>
Oct 23 15:25:44 user nova-compute[74421]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='pci.0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </controller>
Oct 23 15:25:44 user nova-compute[74421]:     <controller type='ide' index='0'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='ide'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 15:25:44 user nova-compute[74421]:     </controller>
Oct 23 15:25:44 user nova-compute[74421]:     <interface type='ethernet'>
Oct 23 15:25:44 user nova-compute[74421]:       <mac address='fa:16:3e:2a:3d:78'/>
Oct 23 15:25:44 user nova-compute[74421]:       <target dev='tap04f12269-17'/>
Oct 23 15:25:44 user nova-compute[74421]:       <model type='virtio'/>
Oct 23 15:25:44 user nova-compute[74421]:       <mtu size='1442'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='net0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </interface>
Oct 23 15:25:44 user nova-compute[74421]:     <serial type='pty'>
Oct 23 15:25:44 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:44 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:44 user nova-compute[74421]:       <target type='isa-serial' port='0'>
Oct 23 15:25:44 user nova-compute[74421]:         <model name='isa-serial'/>
Oct 23 15:25:44 user nova-compute[74421]:       </target>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </serial>
Oct 23 15:25:44 user nova-compute[74421]:     <console type='pty' tty='/dev/pts/7'>
Oct 23 15:25:44 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:44 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:44 user nova-compute[74421]:       <target type='serial' port='0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </console>
Oct 23 15:25:44 user nova-compute[74421]:     <input type='mouse' bus='ps2'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='input0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </input>
Oct 23 15:25:44 user nova-compute[74421]:     <input type='keyboard' bus='ps2'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='input1'/>
Oct 23 15:25:44 user nova-compute[74421]:     </input>
Oct 23 15:25:44 user nova-compute[74421]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 23 15:25:44 user nova-compute[74421]:       <listen type='address' address='0.0.0.0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </graphics>
Oct 23 15:25:44 user nova-compute[74421]:     <audio id='1' type='none'/>
Oct 23 15:25:44 user nova-compute[74421]:     <video>
Oct 23 15:25:44 user nova-compute[74421]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='video0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </video>
Oct 23 15:25:44 user nova-compute[74421]:     <memballoon model='virtio'>
Oct 23 15:25:44 user nova-compute[74421]:       <stats period='10'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='balloon0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:44 user nova-compute[74421]:     <rng model='virtio'>
Oct 23 15:25:44 user nova-compute[74421]:       <backend model='random'>/dev/urandom</backend>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='rng0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </rng>
Oct 23 15:25:44 user nova-compute[74421]:   </devices>
Oct 23 15:25:44 user nova-compute[74421]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 15:25:44 user nova-compute[74421]:     <label>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</label>
Oct 23 15:25:44 user nova-compute[74421]:     <imagelabel>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</imagelabel>
Oct 23 15:25:44 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:44 user nova-compute[74421]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 15:25:44 user nova-compute[74421]:     <label>+64055:+108</label>
Oct 23 15:25:44 user nova-compute[74421]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 15:25:44 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:44 user nova-compute[74421]: </domain>
Oct 23 15:25:44 user nova-compute[74421]:  {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface> {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ca:73:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap4011a046-1a"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 23 15:25:44 user nova-compute[74421]:   <name>instance-00000008</name>
Oct 23 15:25:44 user nova-compute[74421]:   <uuid>e7724770-32d5-49c0-98d4-a2f2f17f15a8</uuid>
Oct 23 15:25:44 user nova-compute[74421]:   <metadata>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:44 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:25:43</nova:creationTime>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:25:44 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:owner>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:owner>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:ports>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:25:44 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:25:44 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:ports>
Oct 23 15:25:44 user nova-compute[74421]: </nova:instance>
Oct 23 15:25:44 user nova-compute[74421]:   </metadata>
Oct 23 15:25:44 user nova-compute[74421]:   <memory unit='KiB'>524288</memory>
Oct 23 15:25:44 user nova-compute[74421]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 15:25:44 user nova-compute[74421]:   <vcpu placement='static'>1</vcpu>
Oct 23 15:25:44 user nova-compute[74421]:   <resource>
Oct 23 15:25:44 user nova-compute[74421]:     <partition>/machine</partition>
Oct 23 15:25:44 user nova-compute[74421]:   </resource>
Oct 23 15:25:44 user nova-compute[74421]:   <sysinfo type='smbios'>
Oct 23 15:25:44 user nova-compute[74421]:     <system>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='version'>0.0.0</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='serial'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='uuid'>e7724770-32d5-49c0-98d4-a2f2f17f15a8</entry>
Oct 23 15:25:44 user nova-compute[74421]:       <entry name='family'>Virtual Machine</entry>
Oct 23 15:25:44 user nova-compute[74421]:     </system>
Oct 23 15:25:44 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:44 user nova-compute[74421]:   <os>
Oct 23 15:25:44 user nova-compute[74421]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 15:25:44 user nova-compute[74421]:     <boot dev='hd'/>
Oct 23 15:25:44 user nova-compute[74421]:     <smbios mode='sysinfo'/>
Oct 23 15:25:44 user nova-compute[74421]:   </os>
Oct 23 15:25:44 user nova-compute[74421]:   <features>
Oct 23 15:25:44 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:44 user nova-compute[74421]:     <apic/>
Oct 23 15:25:44 user nova-compute[74421]:     <vmcoreinfo state='on'/>
Oct 23 15:25:44 user nova-compute[74421]:   </features>
Oct 23 15:25:44 user nova-compute[74421]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 15:25:44 user nova-compute[74421]:     <model fallback='forbid'>Nehalem</model>
Oct 23 15:25:44 user nova-compute[74421]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 15:25:44 user nova-compute[74421]:     <feature policy='require' name='vme'/>
Oct 23 15:25:44 user nova-compute[74421]:     <feature policy='require' name='x2apic'/>
Oct 23 15:25:44 user nova-compute[74421]:     <feature policy='require' name='hypervisor'/>
Oct 23 15:25:44 user nova-compute[74421]:   </cpu>
Oct 23 15:25:44 user nova-compute[74421]:   <clock offset='utc'>
Oct 23 15:25:44 user nova-compute[74421]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 15:25:44 user nova-compute[74421]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 15:25:44 user nova-compute[74421]:     <timer name='hpet' present='no'/>
Oct 23 15:25:44 user nova-compute[74421]:   </clock>
Oct 23 15:25:44 user nova-compute[74421]:   <on_poweroff>destroy</on_poweroff>
Oct 23 15:25:44 user nova-compute[74421]:   <on_reboot>restart</on_reboot>
Oct 23 15:25:44 user nova-compute[74421]:   <on_crash>destroy</on_crash>
Oct 23 15:25:44 user nova-compute[74421]:   <devices>
Oct 23 15:25:44 user nova-compute[74421]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 15:25:44 user nova-compute[74421]:     <disk type='file' device='disk'>
Oct 23 15:25:44 user nova-compute[74421]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 15:25:44 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk' index='2'/>
Oct 23 15:25:44 user nova-compute[74421]:       <backingStore type='file' index='3'>
Oct 23 15:25:44 user nova-compute[74421]:         <format type='raw'/>
Oct 23 15:25:44 user nova-compute[74421]:         <source file='/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee'/>
Oct 23 15:25:44 user nova-compute[74421]:         <backingStore/>
Oct 23 15:25:44 user nova-compute[74421]:       </backingStore>
Oct 23 15:25:44 user nova-compute[74421]:       <target dev='vda' bus='virtio'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='virtio-disk0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </disk>
Oct 23 15:25:44 user nova-compute[74421]:     <disk type='file' device='cdrom'>
Oct 23 15:25:44 user nova-compute[74421]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 15:25:44 user nova-compute[74421]:       <source file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/disk.config' index='1'/>
Oct 23 15:25:44 user nova-compute[74421]:       <backingStore/>
Oct 23 15:25:44 user nova-compute[74421]:       <target dev='hda' bus='ide'/>
Oct 23 15:25:44 user nova-compute[74421]:       <readonly/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='ide0-0-0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </disk>
Oct 23 15:25:44 user nova-compute[74421]:     <controller type='usb' index='0' model='none'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='usb'/>
Oct 23 15:25:44 user nova-compute[74421]:     </controller>
Oct 23 15:25:44 user nova-compute[74421]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='pci.0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </controller>
Oct 23 15:25:44 user nova-compute[74421]:     <controller type='ide' index='0'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='ide'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 15:25:44 user nova-compute[74421]:     </controller>
Oct 23 15:25:44 user nova-compute[74421]:     <interface type='ethernet'>
Oct 23 15:25:44 user nova-compute[74421]:       <mac address='fa:16:3e:2a:3d:78'/>
Oct 23 15:25:44 user nova-compute[74421]:       <target dev='tap04f12269-17'/>
Oct 23 15:25:44 user nova-compute[74421]:       <model type='virtio'/>
Oct 23 15:25:44 user nova-compute[74421]:       <mtu size='1442'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='net0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </interface>
Oct 23 15:25:44 user nova-compute[74421]:     <serial type='pty'>
Oct 23 15:25:44 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:44 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:44 user nova-compute[74421]:       <target type='isa-serial' port='0'>
Oct 23 15:25:44 user nova-compute[74421]:         <model name='isa-serial'/>
Oct 23 15:25:44 user nova-compute[74421]:       </target>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </serial>
Oct 23 15:25:44 user nova-compute[74421]:     <console type='pty' tty='/dev/pts/7'>
Oct 23 15:25:44 user nova-compute[74421]:       <source path='/dev/pts/7'/>
Oct 23 15:25:44 user nova-compute[74421]:       <log file='/opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8/console.log' append='off'/>
Oct 23 15:25:44 user nova-compute[74421]:       <target type='serial' port='0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='serial0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </console>
Oct 23 15:25:44 user nova-compute[74421]:     <input type='mouse' bus='ps2'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='input0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </input>
Oct 23 15:25:44 user nova-compute[74421]:     <input type='keyboard' bus='ps2'>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='input1'/>
Oct 23 15:25:44 user nova-compute[74421]:     </input>
Oct 23 15:25:44 user nova-compute[74421]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 23 15:25:44 user nova-compute[74421]:       <listen type='address' address='0.0.0.0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </graphics>
Oct 23 15:25:44 user nova-compute[74421]:     <audio id='1' type='none'/>
Oct 23 15:25:44 user nova-compute[74421]:     <video>
Oct 23 15:25:44 user nova-compute[74421]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='video0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </video>
Oct 23 15:25:44 user nova-compute[74421]:     <memballoon model='virtio'>
Oct 23 15:25:44 user nova-compute[74421]:       <stats period='10'/>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='balloon0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:44 user nova-compute[74421]:     <rng model='virtio'>
Oct 23 15:25:44 user nova-compute[74421]:       <backend model='random'>/dev/urandom</backend>
Oct 23 15:25:44 user nova-compute[74421]:       <alias name='rng0'/>
Oct 23 15:25:44 user nova-compute[74421]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 15:25:44 user nova-compute[74421]:     </rng>
Oct 23 15:25:44 user nova-compute[74421]:   </devices>
Oct 23 15:25:44 user nova-compute[74421]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 15:25:44 user nova-compute[74421]:     <label>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</label>
Oct 23 15:25:44 user nova-compute[74421]:     <imagelabel>libvirt-e7724770-32d5-49c0-98d4-a2f2f17f15a8</imagelabel>
Oct 23 15:25:44 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:44 user nova-compute[74421]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 15:25:44 user nova-compute[74421]:     <label>+64055:+108</label>
Oct 23 15:25:44 user nova-compute[74421]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 15:25:44 user nova-compute[74421]:   </seclabel>
Oct 23 15:25:44 user nova-compute[74421]: </domain>
Oct 23 15:25:44 user nova-compute[74421]:  {{(pid=74421) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 15:25:44 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Detaching interface fa:16:3e:ca:73:d6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4011a046-1a' not found.
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Converting VIF {"id": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "address": "fa:16:3e:ca:73:d6", "network": {"id": "81a58e73-8826-4a34-b1c5-74a92da38563", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032975788", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4011a046-1a", "ovs_interfaceid": "4011a046-1acf-4911-b4cc-2e40e63dda1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG os_vif [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4011a046-1a, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:44 user nova-compute[74421]: INFO os_vif [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:d6,bridge_name='br-int',has_traffic_filtering=True,id=4011a046-1acf-4911-b4cc-2e40e63dda1e,network=Network(81a58e73-8826-4a34-b1c5-74a92da38563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4011a046-1a')
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [req-80eeea92-89b6-4276-b826-89d0ef2819fe req-38d74784-c53a-4420-adff-baa06128618f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:44 user nova-compute[74421]:   <nova:package version="0.0.0"/>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:name>tempest-device-tagging-server-1770289981</nova:name>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:creationTime>2023-10-23 15:25:44</nova:creationTime>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:flavor name="m1.tiny">
Oct 23 15:25:44 user nova-compute[74421]:     <nova:memory>512</nova:memory>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:disk>1</nova:disk>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:swap>0</nova:swap>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:flavor>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:owner>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:user uuid="0b83377d1f6643c696cce0af08335438">tempest-TaggedAttachmentsTest-1703794066-project-member</nova:user>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:project uuid="8557c583d6da4580af96f29504437579">tempest-TaggedAttachmentsTest-1703794066</nova:project>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:owner>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:25:44 user nova-compute[74421]:   <nova:ports>
Oct 23 15:25:44 user nova-compute[74421]:     <nova:port uuid="04f12269-17e7-4d85-935d-1ecef64f8eba">
Oct 23 15:25:44 user nova-compute[74421]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:25:44 user nova-compute[74421]:     </nova:port>
Oct 23 15:25:44 user nova-compute[74421]:   </nova:ports>
Oct 23 15:25:44 user nova-compute[74421]: </nova:instance>
Oct 23 15:25:44 user nova-compute[74421]:  {{(pid=74421) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [{"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Releasing lock "refresh_cache-e7724770-32d5-49c0-98d4-a2f2f17f15a8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:25:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a8bc2510-8066-46e0-846f-7282e2bd73b4 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "interface-e7724770-32d5-49c0-98d4-a2f2f17f15a8-4011a046-1acf-4911-b4cc-2e40e63dda1e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.862s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:25:57 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Creating image(s)
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Ensure instance console log exists: /opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Start _get_guest_xml network_info=[{"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '14a1c2a9-b6d3-42ff-a464-70b186da9dfe', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46cfd9e6-88d4-48ee-af46-ab81bfcabd23', 'attached_at': '', 'detached_at': '', 'volume_id': '71094d46-9be0-44cb-956e-1779b12eca5f', 'serial': '71094d46-9be0-44cb-956e-1779b12eca5f'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:25:57 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 15:25:57 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:25:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:25:57 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[68edebef-6a37-48a4-8c97-9acbe91b22c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:25:57 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[140585b9-1853-4213-9fd9-b8e4e0e25ddc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f] added
Oct 23 15:25:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed6b0b1-c0c1-4f1e-ab90-7b7627473d99]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc284907-57da-46f7-92d2-3ee833fd8dc7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFlRmYen {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFlRmYen" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d9a9ad-cbcc-489f-8197-3a6fe0147bb2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFlRmYen'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea84df7-3172-45dc-a79b-3c48a5b9033c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[024eb3f9-31db-4913-8505-534a09334a25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7fb0eb-1991-45f5-877a-ef7bfe1bb393]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]
Oct 23 15:25:57 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.
Oct 23 15:25:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a2374-d2d8-408f-aaeb-f10ccd36936f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e97b7-c4ea-4156-a55f-8994be34adf7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:25:57 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:25:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d8d98-39e7-435b-ace6-12f68ea96f09]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:25:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23963396139356361', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396139356361', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1503561539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1799553775',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO75MIGajf4Vw0rXTyRtpSg+qnILL/OJtrCnJSVMDBhv5R1AbedUiPG4/up8ZrSFTDr6ikRP14S05M5xhw0sRohywM06zWPRCpRMWEriANOZNXkKi6kDB6U7/eSItRBg3A==',key_name='tempest-keypair-1846128662',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9f258e8819140888feb117e19e1758b',ramdisk_id='',reservation_id='r-cbzjtcm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-595791159',owner_user_name='tempest-ServerActionsV293TestJSON-595791159-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:25:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b95c80b39db4d168440aea6ba214333',uuid=46cfd9e6-88d4-48ee-af46-ab81bfcabd23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converting VIF {"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:25:58 user nova-compute[74421]:   <uuid>46cfd9e6-88d4-48ee-af46-ab81bfcabd23</uuid>
Oct 23 15:25:58 user nova-compute[74421]:   <name>instance-0000000a</name>
Oct 23 15:25:58 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:25:58 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:25:58 user nova-compute[74421]:   <metadata>
Oct 23 15:25:58 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:25:58 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:25:58 user nova-compute[74421]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1503561539</nova:name>
Oct 23 15:25:58 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:25:57</nova:creationTime>
Oct 23 15:25:58 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:25:58 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:25:58 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:25:58 user nova-compute[74421]:       <nova:owner>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:user uuid="2b95c80b39db4d168440aea6ba214333">tempest-ServerActionsV293TestJSON-595791159-project-member</nova:user>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:project uuid="a9f258e8819140888feb117e19e1758b">tempest-ServerActionsV293TestJSON-595791159</nova:project>
Oct 23 15:25:58 user nova-compute[74421]:       </nova:owner>
Oct 23 15:25:58 user nova-compute[74421]:       <nova:ports>
Oct 23 15:25:58 user nova-compute[74421]:         <nova:port uuid="92806353-ba4b-4e20-b238-cf6d08443a8b">
Oct 23 15:25:58 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:25:58 user nova-compute[74421]:         </nova:port>
Oct 23 15:25:58 user nova-compute[74421]:       </nova:ports>
Oct 23 15:25:58 user nova-compute[74421]:     </nova:instance>
Oct 23 15:25:58 user nova-compute[74421]:   </metadata>
Oct 23 15:25:58 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:25:58 user nova-compute[74421]:     <system>
Oct 23 15:25:58 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:25:58 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:25:58 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:25:58 user nova-compute[74421]:       <entry name="serial">46cfd9e6-88d4-48ee-af46-ab81bfcabd23</entry>
Oct 23 15:25:58 user nova-compute[74421]:       <entry name="uuid">46cfd9e6-88d4-48ee-af46-ab81bfcabd23</entry>
Oct 23 15:25:58 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:25:58 user nova-compute[74421]:     </system>
Oct 23 15:25:58 user nova-compute[74421]:   </sysinfo>
Oct 23 15:25:58 user nova-compute[74421]:   <os>
Oct 23 15:25:58 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:25:58 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:25:58 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:25:58 user nova-compute[74421]:   </os>
Oct 23 15:25:58 user nova-compute[74421]:   <features>
Oct 23 15:25:58 user nova-compute[74421]:     <acpi/>
Oct 23 15:25:58 user nova-compute[74421]:     <apic/>
Oct 23 15:25:58 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:25:58 user nova-compute[74421]:   </features>
Oct 23 15:25:58 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:25:58 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:25:58 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:25:58 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:25:58 user nova-compute[74421]:   </clock>
Oct 23 15:25:58 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:25:58 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:25:58 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:25:58 user nova-compute[74421]:   </cpu>
Oct 23 15:25:58 user nova-compute[74421]:   <devices>
Oct 23 15:25:58 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:25:58 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:25:58 user nova-compute[74421]:       <source dev="/dev/sdf"/>
Oct 23 15:25:58 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:25:58 user nova-compute[74421]:       <serial>71094d46-9be0-44cb-956e-1779b12eca5f</serial>
Oct 23 15:25:58 user nova-compute[74421]:     </disk>
Oct 23 15:25:58 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:25:58 user nova-compute[74421]:       <mac address="fa:16:3e:81:63:37"/>
Oct 23 15:25:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:58 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:25:58 user nova-compute[74421]:       <target dev="tap92806353-ba"/>
Oct 23 15:25:58 user nova-compute[74421]:     </interface>
Oct 23 15:25:58 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:25:58 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23/console.log" append="off"/>
Oct 23 15:25:58 user nova-compute[74421]:     </serial>
Oct 23 15:25:58 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:25:58 user nova-compute[74421]:     <video>
Oct 23 15:25:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:25:58 user nova-compute[74421]:     </video>
Oct 23 15:25:58 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:25:58 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:25:58 user nova-compute[74421]:     </rng>
Oct 23 15:25:58 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:25:58 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:25:58 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:25:58 user nova-compute[74421]:     </memballoon>
Oct 23 15:25:58 user nova-compute[74421]:   </devices>
Oct 23 15:25:58 user nova-compute[74421]: </domain>
Oct 23 15:25:58 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1503561539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1799553775',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO75MIGajf4Vw0rXTyRtpSg+qnILL/OJtrCnJSVMDBhv5R1AbedUiPG4/up8ZrSFTDr6ikRP14S05M5xhw0sRohywM06zWPRCpRMWEriANOZNXkKi6kDB6U7/eSItRBg3A==',key_name='tempest-keypair-1846128662',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9f258e8819140888feb117e19e1758b',ramdisk_id='',reservation_id='r-cbzjtcm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-595791159',owner_user_name='tempest-ServerActionsV293TestJSON-595791159-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:25:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b95c80b39db4d168440aea6ba214333',uuid=46cfd9e6-88d4-48ee-af46-ab81bfcabd23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converting VIF {"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG os_vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6e69a63-de16-56ee-827e-c3fee24454e5', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92806353-ba, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92806353-ba, col_values=(('qos', UUID('cc635f88-34cf-47bc-a8e6-697fbc60cc55')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92806353-ba, col_values=(('external_ids', {'iface-id': '92806353-ba4b-4e20-b238-cf6d08443a8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:63:37', 'vm-uuid': '46cfd9e6-88d4-48ee-af46-ab81bfcabd23'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:58 user nova-compute[74421]: INFO os_vif [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba')
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:25:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] No VIF found with MAC fa:16:3e:81:63:37, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:25:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:25:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-6bc9616f-6a3a-4fa5-a3ae-63a970a39ba0 req-1f6e47fd-34c0-442f-a83c-1bf86322c9c9 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6bc9616f-6a3a-4fa5-a3ae-63a970a39ba0 req-1f6e47fd-34c0-442f-a83c-1bf86322c9c9 service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6bc9616f-6a3a-4fa5-a3ae-63a970a39ba0 req-1f6e47fd-34c0-442f-a83c-1bf86322c9c9 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6bc9616f-6a3a-4fa5-a3ae-63a970a39ba0 req-1f6e47fd-34c0-442f-a83c-1bf86322c9c9 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-6bc9616f-6a3a-4fa5-a3ae-63a970a39ba0 req-1f6e47fd-34c0-442f-a83c-1bf86322c9c9 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:00 user nova-compute[74421]: WARNING nova.compute.manager [req-6bc9616f-6a3a-4fa5-a3ae-63a970a39ba0 req-1f6e47fd-34c0-442f-a83c-1bf86322c9c9 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state active and task_state rebuild_spawning.
Oct 23 15:26:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:26:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance spawned successfully.
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74421) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d0c99eda-c72a-43e4-82c8-de702361c9f2 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-1730642d-e55b-4ee6-811c-14bfe832bb03 req-25dc13fb-58f1-4048-9220-8dd47b9a9afc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1730642d-e55b-4ee6-811c-14bfe832bb03 req-25dc13fb-58f1-4048-9220-8dd47b9a9afc service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1730642d-e55b-4ee6-811c-14bfe832bb03 req-25dc13fb-58f1-4048-9220-8dd47b9a9afc service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1730642d-e55b-4ee6-811c-14bfe832bb03 req-25dc13fb-58f1-4048-9220-8dd47b9a9afc service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-1730642d-e55b-4ee6-811c-14bfe832bb03 req-25dc13fb-58f1-4048-9220-8dd47b9a9afc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:02 user nova-compute[74421]: WARNING nova.compute.manager [req-1730642d-e55b-4ee6-811c-14bfe832bb03 req-25dc13fb-58f1-4048-9220-8dd47b9a9afc service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state active and task_state None.
Oct 23 15:26:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:04 user nova-compute[74421]: INFO nova.compute.manager [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Terminating instance
Oct 23 15:26:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Instance destroyed successfully.
Oct 23 15:26:05 user nova-compute[74421]: DEBUG nova.objects.instance [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lazy-loading 'resources' on Instance uuid 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1806191157',display_name='tempest-VolumesAssistedSnapshotsTest-server-1806191157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1806191157',id=9,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlbBGsAQmIW1sEYUWnhTwM/o1JJJbFKJmhs0zmBrWUX0SPypW7usHF/7D60EXFhVnoVWefNnKWq/uZ8O7VS54YN1A8HZhrMp11wmrppjchmVNz/rXWUdgOim1B+Nk8tIg==',key_name='tempest-keypair-127118244',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f13b83c4f78442a2a5602edb51aea4da',ramdisk_id='',reservation_id='r-id506pyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1708900774',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1708900774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5991af6144ca422195845fe38c37df25',uuid=9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Converting VIF {"id": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "address": "fa:16:3e:b2:6d:70", "network": {"id": "533cb9b2-ed30-45d5-8223-6c6371c0bb5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1346307795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13b83c4f78442a2a5602edb51aea4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd81742e-8f", "ovs_interfaceid": "dd81742e-8f5e-40e5-baba-caff848f8bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG os_vif [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd81742e-8f, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e9eaba3-842c-4f30-88d6-c6bd57191ddd) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:05 user nova-compute[74421]: INFO os_vif [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6d:70,bridge_name='br-int',has_traffic_filtering=True,id=dd81742e-8f5e-40e5-baba-caff848f8bb9,network=Network(533cb9b2-ed30-45d5-8223-6c6371c0bb5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd81742e-8f')
Oct 23 15:26:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Deleting instance files /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9_del
Oct 23 15:26:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Deletion of /opt/stack/data/nova/instances/9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9_del complete
Oct 23 15:26:05 user nova-compute[74421]: INFO nova.compute.manager [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 23 15:26:05 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:26:05 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:26:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-b5b5d648-fa3b-4f5c-90fd-81f8ae5ae605 req-71e030b4-6d2f-4326-b694-92d0c03887bb service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-vif-unplugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b5b5d648-fa3b-4f5c-90fd-81f8ae5ae605 req-71e030b4-6d2f-4326-b694-92d0c03887bb service nova] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b5b5d648-fa3b-4f5c-90fd-81f8ae5ae605 req-71e030b4-6d2f-4326-b694-92d0c03887bb service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b5b5d648-fa3b-4f5c-90fd-81f8ae5ae605 req-71e030b4-6d2f-4326-b694-92d0c03887bb service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-b5b5d648-fa3b-4f5c-90fd-81f8ae5ae605 req-71e030b4-6d2f-4326-b694-92d0c03887bb service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] No waiting events found dispatching network-vif-unplugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-b5b5d648-fa3b-4f5c-90fd-81f8ae5ae605 req-71e030b4-6d2f-4326-b694-92d0c03887bb service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-vif-unplugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:07 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:07 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:07 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed5c77-1a98-497a-bbed-bfef045a3aa0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:26:07 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e6088b-cb21-4062-ab92-d60d48b6f726]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9] added
Oct 23 15:26:07 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced805c1-8aa5-4f6a-8c90-d81efbff3ced]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[88084692-a292-4672-bb5f-bfef7591c447]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYJqGDtx {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Took 2.58 seconds to deallocate network for instance.
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYJqGDtx" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4714b886-1303-41c4-b841-e0b004562f3a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-4c0f2aed-0c82-44e2-8853-c5d766f272c6 req-f1ab1566-6864-4602-93d6-5dba23dedc5d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-vif-deleted-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:07 user nova-compute[74421]: INFO nova.compute.manager [req-4c0f2aed-0c82-44e2-8853-c5d766f272c6 req-f1ab1566-6864-4602-93d6-5dba23dedc5d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Neutron deleted interface dd81742e-8f5e-40e5-baba-caff848f8bb9; detaching it from the instance and deleting it from the info cache
Oct 23 15:26:07 user nova-compute[74421]: DEBUG nova.network.neutron [req-4c0f2aed-0c82-44e2-8853-c5d766f272c6 req-f1ab1566-6864-4602-93d6-5dba23dedc5d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYJqGDtx'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-4c0f2aed-0c82-44e2-8853-c5d766f272c6 req-f1ab1566-6864-4602-93d6-5dba23dedc5d service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Detach interface failed, port_id=dd81742e-8f5e-40e5-baba-caff848f8bb9, reason: Instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[144fc553-bf1c-4bf6-b181-45e41641b3d5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5732f8-22c8-4c8c-885a-b6b4fe13bdb4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:07 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:07 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:07 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d80799d-aab7-4821-b8c5-e827c6d0b50b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]
Oct 23 15:26:07 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.
Oct 23 15:26:07 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2ad34-0514-4d40-a0d6-88aaee0c627d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f1796-24d3-450b-b420-46a05193305c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:08 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:08 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:08 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d1c06-2d2f-4393-a210-dd9910c0006a]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:08 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Deleted allocations for instance 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1e26bb21-091c-4108-b9ad-975f15191c48 tempest-VolumesAssistedSnapshotsTest-1708900774 tempest-VolumesAssistedSnapshotsTest-1708900774-project-member] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.196s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-a8b43429-e6d9-4ac6-8176-d43c37fe2e87 req-303e5cd8-c11f-4704-8e2d-02e2ed328f75 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received event network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a8b43429-e6d9-4ac6-8176-d43c37fe2e87 req-303e5cd8-c11f-4704-8e2d-02e2ed328f75 service nova] Acquiring lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a8b43429-e6d9-4ac6-8176-d43c37fe2e87 req-303e5cd8-c11f-4704-8e2d-02e2ed328f75 service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a8b43429-e6d9-4ac6-8176-d43c37fe2e87 req-303e5cd8-c11f-4704-8e2d-02e2ed328f75 service nova] Lock "9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-a8b43429-e6d9-4ac6-8176-d43c37fe2e87 req-303e5cd8-c11f-4704-8e2d-02e2ed328f75 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] No waiting events found dispatching network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:08 user nova-compute[74421]: WARNING nova.compute.manager [req-a8b43429-e6d9-4ac6-8176-d43c37fe2e87 req-303e5cd8-c11f-4704-8e2d-02e2ed328f75 service nova] [instance: 9b88eeb3-dbb1-4ea0-9bf1-4f0c6fa75eb9] Received unexpected event network-vif-plugged-dd81742e-8f5e-40e5-baba-caff848f8bb9 for instance with vm_state deleted and task_state None.
Oct 23 15:26:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26631343332616537', 'path': '/dev/sdh'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343332616537', 'path': '/dev/sdh'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'flavor' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:26:09 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:26:09 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:26:09 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:26:09 user nova-compute[74421]:   <serial>1b86caa5-8282-4d91-8d51-b75cdd1bc9a9</serial>
Oct 23 15:26:09 user nova-compute[74421]: </disk>
Oct 23 15:26:09 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No VIF found with MAC fa:16:3e:c9:79:7e, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:26:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c53a6863-701b-4665-800a-9f26490e5c35 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.842s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:26:11 user nova-compute[74421]: INFO nova.compute.claims [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Claim successful on node user
Oct 23 15:26:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:26:11 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:26:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.policy [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd080c04ce224a4dbad1e611513ac25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0fe2b9ed6a475db57eb0776af27512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:26:12 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Creating image(s)
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "/opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "/opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.233s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk 1073741824" returned: 0 in 0.079s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Stashing vm_state: active {{(pid=74421) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:26:12 user nova-compute[74421]: INFO nova.compute.claims [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Claim successful on node user
Oct 23 15:26:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Successfully created port: e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:26:13 user nova-compute[74421]: INFO nova.compute.resource_tracker [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating resource usage from migration d1dedd3d-61c0-4787-932d-88963e592c50
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Cannot resize image /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Ensure instance console log exists: /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.675s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:13 user nova-compute[74421]: INFO nova.compute.manager [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Migrating
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:13 user nova-compute[74421]: INFO nova.compute.rpcapi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Successfully updated port: e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquired lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-changed-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Refreshing instance network info cache due to event network-changed-e31e3015-9410-4ee0-ac86-52b2dc900289. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] Acquiring lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-changed-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Refreshing instance network info cache due to event network-changed-0fb10811-2884-415d-8dc7-edb887d2e0b7. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] Acquiring lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] Acquired lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Refreshing network info cache for port 0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:13 user nova-compute[74421]: INFO nova.compute.manager [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Terminating instance
Oct 23 15:26:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "62358513-c579-4486-925b-98371a35f1bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "62358513-c579-4486-925b-98371a35f1bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "62358513-c579-4486-925b-98371a35f1bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:14 user nova-compute[74421]: INFO nova.compute.manager [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Terminating instance
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Instance destroyed successfully.
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.objects.instance [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lazy-loading 'resources' on Instance uuid e7724770-32d5-49c0-98d4-a2f2f17f15a8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1770289981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1770289981',id=8,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNPSPigJoYOpwFoSQa2H6nWkr26wyIHDvMFKq22L8D0lmDHA73HqGnfJLAzfI6Be5sri38771DYZsIg66pe7/15tH0/43Sr0XcHiNrCH7P1hrjyxo1gQXr6TUUETH74A==',key_name='tempest-keypair-664614812',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8557c583d6da4580af96f29504437579',ramdisk_id='',reservation_id='r-q0fi4auv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1703794066',owner_user_name='tempest-TaggedAttachmentsTest-1703794066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b83377d1f6643c696cce0af08335438',uuid=e7724770-32d5-49c0-98d4-a2f2f17f15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converting VIF {"id": "04f12269-17e7-4d85-935d-1ecef64f8eba", "address": "fa:16:3e:2a:3d:78", "network": {"id": "45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1363744658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8557c583d6da4580af96f29504437579", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f12269-17", "ovs_interfaceid": "04f12269-17e7-4d85-935d-1ecef64f8eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG os_vif [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04f12269-17, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13dd71f0-160b-44cf-af31-6250d565b8cf) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: INFO os_vif [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3d:78,bridge_name='br-int',has_traffic_filtering=True,id=04f12269-17e7-4d85-935d-1ecef64f8eba,network=Network(45b8be5e-cfa4-40e9-a4e6-8d93efd1ccf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f12269-17')
Oct 23 15:26:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Deleting instance files /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8_del
Oct 23 15:26:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Deletion of /opt/stack/data/nova/instances/e7724770-32d5-49c0-98d4-a2f2f17f15a8_del complete
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-07f4ecf5-c467-46f6-bf85-94672c3e4541 req-c35a24ed-dfef-42d2-8bb1-1247f328aca2 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-vif-unplugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07f4ecf5-c467-46f6-bf85-94672c3e4541 req-c35a24ed-dfef-42d2-8bb1-1247f328aca2 service nova] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07f4ecf5-c467-46f6-bf85-94672c3e4541 req-c35a24ed-dfef-42d2-8bb1-1247f328aca2 service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07f4ecf5-c467-46f6-bf85-94672c3e4541 req-c35a24ed-dfef-42d2-8bb1-1247f328aca2 service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-07f4ecf5-c467-46f6-bf85-94672c3e4541 req-c35a24ed-dfef-42d2-8bb1-1247f328aca2 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] No waiting events found dispatching network-vif-unplugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-07f4ecf5-c467-46f6-bf85-94672c3e4541 req-c35a24ed-dfef-42d2-8bb1-1247f328aca2 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-vif-unplugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:14 user nova-compute[74421]: INFO nova.compute.manager [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 23 15:26:14 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:26:14 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updating instance_info_cache with network_info: [{"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Releasing lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Instance network_info: |[{"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] Acquired lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Refreshing network info cache for port e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Start _get_guest_xml network_info=[{"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:15 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:15 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7201247',id=16,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyBc8EP8/qnHv0VvOcjfwanHlfUZiARLJrAtpgkgnTRWKzCvUyKPYnSMoChQ14gByBV1umt1pzlW95lkpaz4GAcZrKds7EW66emUb7PUhcTE4horK9x1aaMOrA4bZK4qQ==',key_name='tempest-keypair-712253721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0fe2b9ed6a475db57eb0776af27512',ramdisk_id='',reservation_id='r-am1v33kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-568703167',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd080c04ce224a4dbad1e611513ac25e',uuid=8d6ead20-f082-416a-a1f4-7e680e3ad9b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Converting VIF {"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 62358513-c579-4486-925b-98371a35f1bf] Instance destroyed successfully.
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'resources' on Instance uuid 62358513-c579-4486-925b-98371a35f1bf {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:26:15 user nova-compute[74421]:   <uuid>8d6ead20-f082-416a-a1f4-7e680e3ad9b7</uuid>
Oct 23 15:26:15 user nova-compute[74421]:   <name>instance-00000010</name>
Oct 23 15:26:15 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:26:15 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:26:15 user nova-compute[74421]:   <metadata>
Oct 23 15:26:15 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:26:15 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:26:15 user nova-compute[74421]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797</nova:name>
Oct 23 15:26:15 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:26:15</nova:creationTime>
Oct 23 15:26:15 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:26:15 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:26:15 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:26:15 user nova-compute[74421]:       <nova:owner>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:user uuid="dd080c04ce224a4dbad1e611513ac25e">tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member</nova:user>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:project uuid="1a0fe2b9ed6a475db57eb0776af27512">tempest-TestServerVolumeAttachScenarioOldVersion-568703167</nova:project>
Oct 23 15:26:15 user nova-compute[74421]:       </nova:owner>
Oct 23 15:26:15 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:26:15 user nova-compute[74421]:       <nova:ports>
Oct 23 15:26:15 user nova-compute[74421]:         <nova:port uuid="e31e3015-9410-4ee0-ac86-52b2dc900289">
Oct 23 15:26:15 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 15:26:15 user nova-compute[74421]:         </nova:port>
Oct 23 15:26:15 user nova-compute[74421]:       </nova:ports>
Oct 23 15:26:15 user nova-compute[74421]:     </nova:instance>
Oct 23 15:26:15 user nova-compute[74421]:   </metadata>
Oct 23 15:26:15 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:26:15 user nova-compute[74421]:     <system>
Oct 23 15:26:15 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:26:15 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:26:15 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:26:15 user nova-compute[74421]:       <entry name="serial">8d6ead20-f082-416a-a1f4-7e680e3ad9b7</entry>
Oct 23 15:26:15 user nova-compute[74421]:       <entry name="uuid">8d6ead20-f082-416a-a1f4-7e680e3ad9b7</entry>
Oct 23 15:26:15 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:26:15 user nova-compute[74421]:     </system>
Oct 23 15:26:15 user nova-compute[74421]:   </sysinfo>
Oct 23 15:26:15 user nova-compute[74421]:   <os>
Oct 23 15:26:15 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:26:15 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:26:15 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:26:15 user nova-compute[74421]:   </os>
Oct 23 15:26:15 user nova-compute[74421]:   <features>
Oct 23 15:26:15 user nova-compute[74421]:     <acpi/>
Oct 23 15:26:15 user nova-compute[74421]:     <apic/>
Oct 23 15:26:15 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:26:15 user nova-compute[74421]:   </features>
Oct 23 15:26:15 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:26:15 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:26:15 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:26:15 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:26:15 user nova-compute[74421]:   </clock>
Oct 23 15:26:15 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:26:15 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:26:15 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:26:15 user nova-compute[74421]:   </cpu>
Oct 23 15:26:15 user nova-compute[74421]:   <devices>
Oct 23 15:26:15 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:26:15 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:26:15 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk"/>
Oct 23 15:26:15 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:26:15 user nova-compute[74421]:     </disk>
Oct 23 15:26:15 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:26:15 user nova-compute[74421]:       <mac address="fa:16:3e:f4:5c:17"/>
Oct 23 15:26:15 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:15 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:26:15 user nova-compute[74421]:       <target dev="tape31e3015-94"/>
Oct 23 15:26:15 user nova-compute[74421]:     </interface>
Oct 23 15:26:15 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:26:15 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/console.log" append="off"/>
Oct 23 15:26:15 user nova-compute[74421]:     </serial>
Oct 23 15:26:15 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:26:15 user nova-compute[74421]:     <video>
Oct 23 15:26:15 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:15 user nova-compute[74421]:     </video>
Oct 23 15:26:15 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:26:15 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:26:15 user nova-compute[74421]:     </rng>
Oct 23 15:26:15 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:26:15 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:26:15 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:26:15 user nova-compute[74421]:     </memballoon>
Oct 23 15:26:15 user nova-compute[74421]:   </devices>
Oct 23 15:26:15 user nova-compute[74421]: </domain>
Oct 23 15:26:15 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7201247',id=16,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyBc8EP8/qnHv0VvOcjfwanHlfUZiARLJrAtpgkgnTRWKzCvUyKPYnSMoChQ14gByBV1umt1pzlW95lkpaz4GAcZrKds7EW66emUb7PUhcTE4horK9x1aaMOrA4bZK4qQ==',key_name='tempest-keypair-712253721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0fe2b9ed6a475db57eb0776af27512',ramdisk_id='',reservation_id='r-am1v33kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-568703167',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd080c04ce224a4dbad1e611513ac25e',uuid=8d6ead20-f082-416a-a1f4-7e680e3ad9b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Converting VIF {"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG os_vif [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-488042625',display_name='tempest-AttachVolumeNegativeTest-server-488042625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-488042625',id=13,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLls99mDl0xCXu753OJVzVLld/luAIARRtY4bFEBBYRXcd02x+kAz9TwILLX/JD22K5C4IVaB/CICESxR+BWqZ2vGo92HVZIHAHKEi1QJvAWNJN6CI32iNhWc0audzuK0w==',key_name='tempest-keypair-1473412201',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-nd9clani',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=62358513-c579-4486-925b-98371a35f1bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG os_vif [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69dea91b-9d8d-5196-b3c2-e5caa44edb64', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fb10811-28, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape31e3015-94, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape31e3015-94, col_values=(('qos', UUID('c6b5031d-f7c7-4215-81a5-a45e9433625d')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape31e3015-94, col_values=(('external_ids', {'iface-id': 'e31e3015-9410-4ee0-ac86-52b2dc900289', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:5c:17', 'vm-uuid': '8d6ead20-f082-416a-a1f4-7e680e3ad9b7'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Starting migrate_disk_and_power_off {{(pid=74421) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: INFO os_vif [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94')
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ee8f7f4-03fa-47e7-8230-765b8f1dc362) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: INFO os_vif [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6f:8b,bridge_name='br-int',has_traffic_filtering=True,id=0fb10811-2884-415d-8dc7-edb887d2e0b7,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb10811-28')
Oct 23 15:26:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Deleting instance files /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf_del
Oct 23 15:26:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Deletion of /opt/stack/data/nova/instances/62358513-c579-4486-925b-98371a35f1bf_del complete
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updated VIF entry in instance network info cache for port 0fb10811-2884-415d-8dc7-edb887d2e0b7. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updating instance_info_cache with network_info: [{"id": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "address": "fa:16:3e:93:6f:8b", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb10811-28", "ovs_interfaceid": "0fb10811-2884-415d-8dc7-edb887d2e0b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] No VIF found with MAC fa:16:3e:f4:5c:17, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-77833697-86a3-425a-b442-3eb92cb09c9e req-8a3d1be9-0764-4fe4-984e-79655297da14 service nova] Releasing lock "refresh_cache-62358513-c579-4486-925b-98371a35f1bf" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:15 user nova-compute[74421]: INFO nova.compute.manager [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 62358513-c579-4486-925b-98371a35f1bf] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 23 15:26:15 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 62358513-c579-4486-925b-98371a35f1bf] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 62358513-c579-4486-925b-98371a35f1bf] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updated VIF entry in instance network info cache for port e31e3015-9410-4ee0-ac86-52b2dc900289. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG nova.network.neutron [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updating instance_info_cache with network_info: [{"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-19630eeb-e28f-4378-a91e-7f172c76c27c req-79442950-ddbe-4d3c-aee3-898fa9327d19 service nova] Releasing lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-unplugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-unplugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-unplugged-04f12269-17e7-4d85-935d-1ecef64f8eba for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] Acquiring lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] No waiting events found dispatching network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:16 user nova-compute[74421]: WARNING nova.compute.manager [req-43ee4390-0977-411d-9605-b6b954c43f47 req-67bd4395-c19e-4812-8ba2-a270226f5bea service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received unexpected event network-vif-plugged-04f12269-17e7-4d85-935d-1ecef64f8eba for instance with vm_state active and task_state deleting.
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:16 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Took 1.11 seconds to deallocate network for instance.
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-11e91b98-c73a-4ff9-b9b4-39c7b8f2a7d5 req-d7ed8fa0-9637-4a88-8855-bedca078258f service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-vif-deleted-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:16 user nova-compute[74421]: INFO nova.compute.manager [req-11e91b98-c73a-4ff9-b9b4-39c7b8f2a7d5 req-d7ed8fa0-9637-4a88-8855-bedca078258f service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Neutron deleted interface 0fb10811-2884-415d-8dc7-edb887d2e0b7; detaching it from the instance and deleting it from the info cache
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.network.neutron [req-11e91b98-c73a-4ff9-b9b4-39c7b8f2a7d5 req-d7ed8fa0-9637-4a88-8855-bedca078258f service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:16 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 62358513-c579-4486-925b-98371a35f1bf] Took 1.01 seconds to deallocate network for instance.
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-11e91b98-c73a-4ff9-b9b4-39c7b8f2a7d5 req-d7ed8fa0-9637-4a88-8855-bedca078258f service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Detach interface failed, port_id=0fb10811-2884-415d-8dc7-edb887d2e0b7, reason: Instance 62358513-c579-4486-925b-98371a35f1bf could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance destroyed successfully.
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dd217a3-a5, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72ebf703-7212-4a21-8a3f-bfbe78963ca4) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:16 user nova-compute[74421]: INFO os_vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5')
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:16 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3e20b4-b70e-42e6-8601-6ce67055d79a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:26:16 user nova-compute[74421]: No targets found.
Oct 23 15:26:16 user nova-compute[74421]: iSNS:
Oct 23 15:26:16 user nova-compute[74421]: No targets found.
Oct 23 15:26:16 user nova-compute[74421]: STATIC:
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:26:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:16 user nova-compute[74421]: FIRMWARE:
Oct 23 15:26:16 user nova-compute[74421]: No targets found.
Oct 23 15:26:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:26:16 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:26:16 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.145s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[970d735e-3217-495a-ae3f-0894267df785]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1864b9b-c291-41bb-b96f-3140e6274c28]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:16 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2480253ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9'): ({'sdh'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Removing single pathed devices sdh {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:26:16 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Deleted allocations for instance e7724770-32d5-49c0-98d4-a2f2f17f15a8
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d740376-7a23-4a42-a22b-4c191b249906]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b18049-13e9-477c-a8f4-1806f6ff390a]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flushing IO for device /dev/sdh {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b30572-7c6c-481c-aaa4-089200c59188]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:26:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-3719c9fd-ede2-45cb-b4cd-931553dbc588 req-4fdeea59-8f40-479c-a31c-45836afe35a2 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received event network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3719c9fd-ede2-45cb-b4cd-931553dbc588 req-4fdeea59-8f40-479c-a31c-45836afe35a2 service nova] Acquiring lock "62358513-c579-4486-925b-98371a35f1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3719c9fd-ede2-45cb-b4cd-931553dbc588 req-4fdeea59-8f40-479c-a31c-45836afe35a2 service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3719c9fd-ede2-45cb-b4cd-931553dbc588 req-4fdeea59-8f40-479c-a31c-45836afe35a2 service nova] Lock "62358513-c579-4486-925b-98371a35f1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-3719c9fd-ede2-45cb-b4cd-931553dbc588 req-4fdeea59-8f40-479c-a31c-45836afe35a2 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] No waiting events found dispatching network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:17 user nova-compute[74421]: WARNING nova.compute.manager [req-3719c9fd-ede2-45cb-b4cd-931553dbc588 req-4fdeea59-8f40-479c-a31c-45836afe35a2 service nova] [instance: 62358513-c579-4486-925b-98371a35f1bf] Received unexpected event network-vif-plugged-0fb10811-2884-415d-8dc7-edb887d2e0b7 for instance with vm_state deleted and task_state None.
Oct 23 15:26:17 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-641ca516-30a7-43e3-8c39-a32b5256b052 tempest-TaggedAttachmentsTest-1703794066 tempest-TaggedAttachmentsTest-1703794066-project-member] Lock "e7724770-32d5-49c0-98d4-a2f2f17f15a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.353s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.338s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a139b77-0f57-45ab-9217-b36850ca8e07]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88d2cd7-ebda-421c-b07c-94cd3566fa20]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:17 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Deleted allocations for instance 62358513-c579-4486-925b-98371a35f1bf
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.146s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa20d40a-4824-4536-8699-17cce051f49f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]
Oct 23 15:26:17 user nova-compute[74421]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.
Oct 23 15:26:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.072s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd1503f-0e45-4548-a884-ad741b3f43b5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.835s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== disconnect_volume: return (837ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3ca62ef6-c327-4fc5-8e1a-aa8ade6eb41a tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "62358513-c579-4486-925b-98371a35f1bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.186s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12_resize/disk /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: e7724770-32d5-49c0-98d4-a2f2f17f15a8] Received event network-vif-deleted-04f12269-17e7-4d85-935d-1ecef64f8eba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:18 user nova-compute[74421]: WARNING nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state active and task_state resize_migrating.
Oct 23 15:26:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:18 user nova-compute[74421]: WARNING nova.compute.manager [req-f9a528f4-35e1-4e36-8b7d-beae80bff91f req-b37c0a0c-ca67-4eda-8e7b-ac3aefa92179 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state active and task_state resize_migrating.
Oct 23 15:26:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12_resize/disk /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk" returned: 0 in 0.431s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12_resize/disk.info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk.info {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12_resize/disk.info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk.info" returned: 0 in 0.039s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] No waiting events found dispatching network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:19 user nova-compute[74421]: WARNING nova.compute.manager [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received unexpected event network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 for instance with vm_state building and task_state spawning.
Oct 23 15:26:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] No waiting events found dispatching network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:19 user nova-compute[74421]: WARNING nova.compute.manager [req-356395b3-38d9-4c58-9d5c-be01d226ae3a req-27441ec7-2b2a-4314-99b8-5761540a6d59 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received unexpected event network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 for instance with vm_state building and task_state spawning.
Oct 23 15:26:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Port 7dd217a3-a501-4e28-a7f6-659356f41eca binding to destination host user is already ACTIVE {{(pid=74421) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:26:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Instance spawned successfully.
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:26:20 user nova-compute[74421]: INFO nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Took 8.05 seconds to spawn the instance on the hypervisor.
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:26:20 user nova-compute[74421]: INFO nova.compute.manager [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Took 9.20 seconds to build instance.
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b008e885-6fb1-4c5a-b666-5eef88c969b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.309s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af25e98f-4d0a-4683-854e-de83de0186fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed2e79-09f4-4d0f-9c57-ce2f50a5cdc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cbf346-bc94-406f-9437-d5d9f1d590de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2649d2-4091-45a0-a163-dda7c205852f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:26:20 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:26:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba79a1ea-4d10-4db6-adc3-860d83976fd9]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:26:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:38 user nova-compute[74421]: INFO nova.compute.manager [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Rescuing
Oct 23 15:26:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:26:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-25483334-6896-44e4-99c7-7f2bb286e3b1 req-a322bd99-7b8d-493b-8a10-2b987fb6531a service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25483334-6896-44e4-99c7-7f2bb286e3b1 req-a322bd99-7b8d-493b-8a10-2b987fb6531a service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25483334-6896-44e4-99c7-7f2bb286e3b1 req-a322bd99-7b8d-493b-8a10-2b987fb6531a service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25483334-6896-44e4-99c7-7f2bb286e3b1 req-a322bd99-7b8d-493b-8a10-2b987fb6531a service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-25483334-6896-44e4-99c7-7f2bb286e3b1 req-a322bd99-7b8d-493b-8a10-2b987fb6531a service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:39 user nova-compute[74421]: WARNING nova.compute.manager [req-25483334-6896-44e4-99c7-7f2bb286e3b1 req-a322bd99-7b8d-493b-8a10-2b987fb6531a service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state active and task_state rescuing.
Oct 23 15:26:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updating instance_info_cache with network_info: [{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance destroyed successfully.
Oct 23 15:26:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Attempting a stable device rescue
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74421) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:26:40 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Creating image(s)
Oct 23 15:26:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "/opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.part --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.virt.images [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] 65655937-63ef-46ab-a28d-13825db28ae3 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.part /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-80e93e32-39da-4b02-b6d6-7f240da6b55e req-efd2c198-db0b-425e-b9d5-01f08cfbea60 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-80e93e32-39da-4b02-b6d6-7f240da6b55e req-efd2c198-db0b-425e-b9d5-01f08cfbea60 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-80e93e32-39da-4b02-b6d6-7f240da6b55e req-efd2c198-db0b-425e-b9d5-01f08cfbea60 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-80e93e32-39da-4b02-b6d6-7f240da6b55e req-efd2c198-db0b-425e-b9d5-01f08cfbea60 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-80e93e32-39da-4b02-b6d6-7f240da6b55e req-efd2c198-db0b-425e-b9d5-01f08cfbea60 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:41 user nova-compute[74421]: WARNING nova.compute.manager [req-80e93e32-39da-4b02-b6d6-7f240da6b55e req-efd2c198-db0b-425e-b9d5-01f08cfbea60 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state active and task_state rescuing.
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Starting finish_migration {{(pid=74421) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:26:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Creating image(s)
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.part /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.converted" returned: 0 in 0.436s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.247s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk. size=21474836480 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.862s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk 21474836480 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8 --force-share --output=json" returned: 0 in 0.238s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk 21474836480" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8,backing_fmt=raw /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8,backing_fmt=raw /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue" returned: 0 in 0.058s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'migration_context' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Ensure instance console log exists: /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start _get_guest_xml network_info=[{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '8c502c09-5bfe-4a6f-b847-cb4ce1de67a2', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee5687a0-6e1a-4ce6-954a-d6959b2c8c12', 'attached_at': '2023-10-23T15:26:41.000000', 'detached_at': '', 'volume_id': '1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'serial': '1b86caa5-8282-4d91-8d51-b75cdd1bc9a9'}, 'boot_index': None, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<7767aaf1-9958-446c-ba3f-708fddb78750> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Start _get_guest_xml network_info=[{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "vif_mac": "fa:16:3e:e5:c7:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '65655937-63ef-46ab-a28d-13825db28ae3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '835af3e0-24ca-4c98-8e2e-ae4da4595114', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7767aaf1-9958-446c-ba3f-708fddb78750', 'attached_at': '', 'detached_at': '', 'volume_id': '96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'serial': '96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'resources' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:42 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:42 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<7767aaf1-9958-446c-ba3f-708fddb78750> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'numa_topology' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:42 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:42 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:42 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<7767aaf1-9958-446c-ba3f-708fddb78750> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:42 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:42 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0517a3ad-0d0d-4279-ac1f-c5ba4ac7132b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:26:42 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca69929-bffb-444d-a3d7-f8643ec7cd7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9] added
Oct 23 15:26:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<7767aaf1-9958-446c-ba3f-708fddb78750> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:42 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ac38e-240d-4237-a0c6-ffbe90c62b7f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[93369718-724b-467f-9711-ee1d69f137a0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYJqGDtx {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYJqGDtx" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a6fc1-e678-453f-8d02-409d4a1db557]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYJqGDtx'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6bbac4-358f-417e-9637-00caf1ade5c7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecbb2ef-07d3-4c99-ade7-d597480a3b92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d63cbb1-5857-4c3d-9f02-f6e8eb0b84e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]
Oct 23 15:26:42 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.
Oct 23 15:26:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a36c78-7836-410d-8b07-b5fd92c7cef1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa31e121-3be2-4b3d-a3bd-5c2001ffd3e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:42 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] HCTL ('39', '-', '-', 0) found on session 15 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0effc9-fa02-4d32-a33b-b49b4ff94ee4]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:26:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26631343332616537', 'path': '/dev/sdh'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343332616537', 'path': '/dev/sdh'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.369s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:43 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:43 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800da98-9546-4d6a-925b-41e6fda14f99]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WcUpzDew\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 15:26:43 user nova-compute[74421]: node.name = iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:26:43 user nova-compute[74421]: node.tpgt = -1
Oct 23 15:26:43 user nova-compute[74421]: node.startup = automatic
Oct 23 15:26:43 user nova-compute[74421]: node.leading_login = No
Oct 23 15:26:43 user nova-compute[74421]: iface.iscsi_ifacename = default
Oct 23 15:26:43 user nova-compute[74421]: iface.net_ifacename = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.ipaddress = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.prefix_len = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.hwaddress = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.transport_name = tcp
Oct 23 15:26:43 user nova-compute[74421]: iface.initiatorname = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.vlan_id = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.vlan_priority = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.vlan_state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.iface_num = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.mtu = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.port = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.bootproto = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.subnet_mask = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.gateway = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_alt_client_id = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_dns = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_learn_iqn = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_vendor_id_state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_vendor_id = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.dhcp_slp_da = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.fragmentation = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.gratuitous_arp = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.incoming_forwarding = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.tos_state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.tos = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.ttl = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.delayed_ack = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.tcp_nagle = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.tcp_wsf_state = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.tcp_wsf = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.tcp_timer_scale = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.tcp_timestamp = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.redirect = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.def_task_mgmt_timeout = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.header_digest = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.data_digest = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.immediate_data = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.initial_r2t = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.data_seq_inorder = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.data_pdu_inorder = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.erl = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.max_receive_data_len = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.first_burst_len = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.max_outstanding_r2t = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.max_burst_len = 0
Oct 23 15:26:43 user nova-compute[74421]: iface.chap_auth = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.bidi_chap = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.strict_login_compliance = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.discovery_auth = <empty>
Oct 23 15:26:43 user nova-compute[74421]: iface.discovery_logout = <empty>
Oct 23 15:26:43 user nova-compute[74421]: node.discovery_address = <empty>
Oct 23 15:26:43 user nova-compute[74421]: node.discovery_port = 0
Oct 23 15:26:43 user nova-compute[74421]: node.discovery_type = static
Oct 23 15:26:43 user nova-compute[74421]: node.session.initial_cmdsn = 0
Oct 23 15:26:43 user nova-compute[74421]: node.session.initial_login_retry_max = 8
Oct 23 15:26:43 user nova-compute[74421]: node.session.xmit_thread_priority = -20
Oct 23 15:26:43 user nova-compute[74421]: node.session.cmds_max = 128
Oct 23 15:26:43 user nova-compute[74421]: node.session.queue_depth = 32
Oct 23 15:26:43 user nova-compute[74421]: node.session.nr_sessions = 1
Oct 23 15:26:43 user nova-compute[74421]: node.session.auth.authmethod = CHAP
Oct 23 15:26:43 user nova-compute[74421]: node.session.auth.username = WcUpzDew
Oct 23 15:26:43 user nova-compute[74421]: node.session.auth.password = ***
Oct 23 15:26:43 user nova-compute[74421]: node.session.auth.username_in = <empty>
Oct 23 15:26:43 user nova-compute[74421]: node.session.auth.password_in = <empty>
Oct 23 15:26:43 user nova-compute[74421]: node.session.auth.chap_algs = MD5
Oct 23 15:26:43 user nova-compute[74421]: node.session.timeo.replacement_timeout = 120
Oct 23 15:26:43 user nova-compute[74421]: node.session.err_timeo.abort_timeout = 15
Oct 23 15:26:43 user nova-compute[74421]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 15:26:43 user nova-compute[74421]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 15:26:43 user nova-compute[74421]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.FastAbort = Yes
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.InitialR2T = No
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.ImmediateData = Yes
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.MaxConnections = 1
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 15:26:43 user nova-compute[74421]: node.session.iscsi.ERL = 0
Oct 23 15:26:43 user nova-compute[74421]: node.session.scan = manual
Oct 23 15:26:43 user nova-compute[74421]: node.session.reopen_max = 0
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].address = 172.16.0.220
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].port = 3260
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].startup = manual
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].tcp.window_size = 524288
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].tcp.type_of_service = 0
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].timeo.logout_timeout = 15
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].timeo.login_timeout = 15
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].timeo.auth_timeout = 45
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].iscsi.DataDigest = None
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].iscsi.IFMarker = No
Oct 23 15:26:43 user nova-compute[74421]: node.conn[0].iscsi.OFMarker = No
Oct 23 15:26:43 user nova-compute[74421]: # END RECORD
Oct 23 15:26:43 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be413f-3366-43b2-80e0-b3b8082ae161]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c939ec-86cc-402c-a2f9-c8ae47796746]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcUpzDew {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcUpzDew" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[13611f59-ff8c-4157-b5ee-32524dfcc705]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:26:44 user nova-compute[74421]:   <uuid>ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</uuid>
Oct 23 15:26:44 user nova-compute[74421]:   <name>instance-00000006</name>
Oct 23 15:26:44 user nova-compute[74421]:   <memory>2097152</memory>
Oct 23 15:26:44 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:26:44 user nova-compute[74421]:   <metadata>
Oct 23 15:26:44 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:26:44 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherB-server-652792039</nova:name>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:26:42</nova:creationTime>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:flavor name="m1.small">
Oct 23 15:26:44 user nova-compute[74421]:         <nova:memory>2048</nova:memory>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:disk>20</nova:disk>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:26:44 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:owner>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:user uuid="ce501ef5d45c43efa6fd1329bd1b417d">tempest-ServerActionsTestOtherB-919492088-project-member</nova:user>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:project uuid="6fd7efc2de094cc6b45ebe7e14aceecb">tempest-ServerActionsTestOtherB-919492088</nova:project>
Oct 23 15:26:44 user nova-compute[74421]:       </nova:owner>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:ports>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:port uuid="7dd217a3-a501-4e28-a7f6-659356f41eca">
Oct 23 15:26:44 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:26:44 user nova-compute[74421]:         </nova:port>
Oct 23 15:26:44 user nova-compute[74421]:       </nova:ports>
Oct 23 15:26:44 user nova-compute[74421]:     </nova:instance>
Oct 23 15:26:44 user nova-compute[74421]:   </metadata>
Oct 23 15:26:44 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:26:44 user nova-compute[74421]:     <system>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="serial">ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="uuid">ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:26:44 user nova-compute[74421]:     </system>
Oct 23 15:26:44 user nova-compute[74421]:   </sysinfo>
Oct 23 15:26:44 user nova-compute[74421]:   <os>
Oct 23 15:26:44 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:26:44 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:26:44 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:26:44 user nova-compute[74421]:   </os>
Oct 23 15:26:44 user nova-compute[74421]:   <features>
Oct 23 15:26:44 user nova-compute[74421]:     <acpi/>
Oct 23 15:26:44 user nova-compute[74421]:     <apic/>
Oct 23 15:26:44 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:26:44 user nova-compute[74421]:   </features>
Oct 23 15:26:44 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:26:44 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:26:44 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:26:44 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:26:44 user nova-compute[74421]:   </clock>
Oct 23 15:26:44 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:26:44 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:26:44 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:26:44 user nova-compute[74421]:   </cpu>
Oct 23 15:26:44 user nova-compute[74421]:   <devices>
Oct 23 15:26:44 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:26:44 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:26:44 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk"/>
Oct 23 15:26:44 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:     </disk>
Oct 23 15:26:44 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:26:44 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:26:44 user nova-compute[74421]:       <source dev="/dev/sdh"/>
Oct 23 15:26:44 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:       <serial>1b86caa5-8282-4d91-8d51-b75cdd1bc9a9</serial>
Oct 23 15:26:44 user nova-compute[74421]:     </disk>
Oct 23 15:26:44 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:26:44 user nova-compute[74421]:       <mac address="fa:16:3e:c9:79:7e"/>
Oct 23 15:26:44 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:26:44 user nova-compute[74421]:       <target dev="tap7dd217a3-a5"/>
Oct 23 15:26:44 user nova-compute[74421]:     </interface>
Oct 23 15:26:44 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:26:44 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/console.log" append="off"/>
Oct 23 15:26:44 user nova-compute[74421]:     </serial>
Oct 23 15:26:44 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:26:44 user nova-compute[74421]:     <video>
Oct 23 15:26:44 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:     </video>
Oct 23 15:26:44 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:26:44 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:26:44 user nova-compute[74421]:     </rng>
Oct 23 15:26:44 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:26:44 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:26:44 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:26:44 user nova-compute[74421]:     </memballoon>
Oct 23 15:26:44 user nova-compute[74421]:   </devices>
Oct 23 15:26:44 user nova-compute[74421]: </domain>
Oct 23 15:26:44 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-415882738-network", "vif_mac": "fa:16:3e:c9:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcUpzDew'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74c9b4e8-b78a-5087-967b-49bf23df1c4c', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3983213b-878f-4c6d-b070-8141b886b8c0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dd217a3-a5, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dd217a3-a5, col_values=(('qos', UUID('e7c3353e-14bb-466d-9835-f8342f3e1e56')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dd217a3-a5, col_values=(('external_ids', {'iface-id': '7dd217a3-a501-4e28-a7f6-659356f41eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:79:7e', 'vm-uuid': 'ee5687a0-6e1a-4ce6-954a-d6959b2c8c12'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: INFO os_vif [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5')
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e9dfd8-8157-42ee-949f-17b876e65ef3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:44 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.497s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] HCTL ('36', '0', '0', 0) found on session 11 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82ca20-b003-4bc4-8a63-8ea65468a282]: (4, ('0 0 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching for a device in session 11 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.564s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== connect_volume: return (1932ms) {'type': 'block', 'scsi_wwn': '23939346262366532', 'path': '/dev/sde'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939346262366532', 'path': '/dev/sde'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-776177048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-776177048',id=14,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-736t0x06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:25:31Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=7767aaf1-9958-446c-ba3f-708fddb78750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "vif_mac": "fa:16:3e:e5:c7:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "vif_mac": "fa:16:3e:e5:c7:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'pci_devices' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] No VIF found with MAC fa:16:3e:c9:79:7e, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.objects.base [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<7767aaf1-9958-446c-ba3f-708fddb78750> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:26:44 user nova-compute[74421]:   <uuid>7767aaf1-9958-446c-ba3f-708fddb78750</uuid>
Oct 23 15:26:44 user nova-compute[74421]:   <name>instance-0000000e</name>
Oct 23 15:26:44 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:26:44 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:26:44 user nova-compute[74421]:   <metadata>
Oct 23 15:26:44 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:26:44 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-776177048</nova:name>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:26:42</nova:creationTime>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:26:44 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:26:44 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:owner>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:user uuid="166776dcccda43409673d99af45d4390">tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member</nova:user>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:project uuid="f733f39c7c95492abc827bd581ca7afa">tempest-ServerBootFromVolumeStableRescueTest-2014752681</nova:project>
Oct 23 15:26:44 user nova-compute[74421]:       </nova:owner>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:26:44 user nova-compute[74421]:       <nova:ports>
Oct 23 15:26:44 user nova-compute[74421]:         <nova:port uuid="13260e7c-d231-43bd-aa15-f5d4f5f3040e">
Oct 23 15:26:44 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:26:44 user nova-compute[74421]:         </nova:port>
Oct 23 15:26:44 user nova-compute[74421]:       </nova:ports>
Oct 23 15:26:44 user nova-compute[74421]:     </nova:instance>
Oct 23 15:26:44 user nova-compute[74421]:   </metadata>
Oct 23 15:26:44 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:26:44 user nova-compute[74421]:     <system>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="serial">7767aaf1-9958-446c-ba3f-708fddb78750</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="uuid">7767aaf1-9958-446c-ba3f-708fddb78750</entry>
Oct 23 15:26:44 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:26:44 user nova-compute[74421]:     </system>
Oct 23 15:26:44 user nova-compute[74421]:   </sysinfo>
Oct 23 15:26:44 user nova-compute[74421]:   <os>
Oct 23 15:26:44 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:26:44 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:26:44 user nova-compute[74421]:   </os>
Oct 23 15:26:44 user nova-compute[74421]:   <features>
Oct 23 15:26:44 user nova-compute[74421]:     <acpi/>
Oct 23 15:26:44 user nova-compute[74421]:     <apic/>
Oct 23 15:26:44 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:26:44 user nova-compute[74421]:   </features>
Oct 23 15:26:44 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:26:44 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:26:44 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:26:44 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:26:44 user nova-compute[74421]:   </clock>
Oct 23 15:26:44 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:26:44 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:26:44 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:26:44 user nova-compute[74421]:   </cpu>
Oct 23 15:26:44 user nova-compute[74421]:   <devices>
Oct 23 15:26:44 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:26:44 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:26:44 user nova-compute[74421]:       <source dev="/dev/sde"/>
Oct 23 15:26:44 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:       <serial>96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4</serial>
Oct 23 15:26:44 user nova-compute[74421]:     </disk>
Oct 23 15:26:44 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:26:44 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:26:44 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue"/>
Oct 23 15:26:44 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:       <boot order="1"/>
Oct 23 15:26:44 user nova-compute[74421]:     </disk>
Oct 23 15:26:44 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:26:44 user nova-compute[74421]:       <mac address="fa:16:3e:e5:c7:76"/>
Oct 23 15:26:44 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:26:44 user nova-compute[74421]:       <target dev="tap13260e7c-d2"/>
Oct 23 15:26:44 user nova-compute[74421]:     </interface>
Oct 23 15:26:44 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:26:44 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/console.log" append="off"/>
Oct 23 15:26:44 user nova-compute[74421]:     </serial>
Oct 23 15:26:44 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:26:44 user nova-compute[74421]:     <video>
Oct 23 15:26:44 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:44 user nova-compute[74421]:     </video>
Oct 23 15:26:44 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:26:44 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:26:44 user nova-compute[74421]:     </rng>
Oct 23 15:26:44 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:26:44 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:26:44 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:26:44 user nova-compute[74421]:     </memballoon>
Oct 23 15:26:44 user nova-compute[74421]:   </devices>
Oct 23 15:26:44 user nova-compute[74421]: </domain>
Oct 23 15:26:44 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:26:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance destroyed successfully.
Oct 23 15:26:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No VIF found with MAC fa:16:3e:e5:c7:76, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-66f77159-fc2b-440d-a874-8fcaebabfa55 req-010c1652-d56e-4bdf-8567-b77cda29c9ac service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66f77159-fc2b-440d-a874-8fcaebabfa55 req-010c1652-d56e-4bdf-8567-b77cda29c9ac service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66f77159-fc2b-440d-a874-8fcaebabfa55 req-010c1652-d56e-4bdf-8567-b77cda29c9ac service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66f77159-fc2b-440d-a874-8fcaebabfa55 req-010c1652-d56e-4bdf-8567-b77cda29c9ac service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-66f77159-fc2b-440d-a874-8fcaebabfa55 req-010c1652-d56e-4bdf-8567-b77cda29c9ac service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:50 user nova-compute[74421]: WARNING nova.compute.manager [req-66f77159-fc2b-440d-a874-8fcaebabfa55 req-010c1652-d56e-4bdf-8567-b77cda29c9ac service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state active and task_state resize_finish.
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-0b68b280-c511-4dcb-a3e7-1ca414bc208a req-3f1a7d69-14e1-4bb7-8e8e-e513f5151d22 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0b68b280-c511-4dcb-a3e7-1ca414bc208a req-3f1a7d69-14e1-4bb7-8e8e-e513f5151d22 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0b68b280-c511-4dcb-a3e7-1ca414bc208a req-3f1a7d69-14e1-4bb7-8e8e-e513f5151d22 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0b68b280-c511-4dcb-a3e7-1ca414bc208a req-3f1a7d69-14e1-4bb7-8e8e-e513f5151d22 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-0b68b280-c511-4dcb-a3e7-1ca414bc208a req-3f1a7d69-14e1-4bb7-8e8e-e513f5151d22 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:50 user nova-compute[74421]: WARNING nova.compute.manager [req-0b68b280-c511-4dcb-a3e7-1ca414bc208a req-3f1a7d69-14e1-4bb7-8e8e-e513f5151d22 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state active and task_state rescuing.
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-c8445a75-c1e8-47c3-8efc-a8a89944caa3 req-1b35ea0a-9778-4485-8374-40232758ef52 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c8445a75-c1e8-47c3-8efc-a8a89944caa3 req-1b35ea0a-9778-4485-8374-40232758ef52 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c8445a75-c1e8-47c3-8efc-a8a89944caa3 req-1b35ea0a-9778-4485-8374-40232758ef52 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c8445a75-c1e8-47c3-8efc-a8a89944caa3 req-1b35ea0a-9778-4485-8374-40232758ef52 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-c8445a75-c1e8-47c3-8efc-a8a89944caa3 req-1b35ea0a-9778-4485-8374-40232758ef52 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:50 user nova-compute[74421]: WARNING nova.compute.manager [req-c8445a75-c1e8-47c3-8efc-a8a89944caa3 req-1b35ea0a-9778-4485-8374-40232758ef52 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state active and task_state resize_finish.
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9f4e1ac3-bc14-4135-ac59-7fb0e55c6924 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:26:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance running successfully.
Oct 23 15:26:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=25.316165924072266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Failed to set time: agent not configured {{(pid=74421) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e4000ae3-b6df-4a7a-be0f-77d78315893c tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] finish_migration finished successfully. {{(pid=74421) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Applying migration context for instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 as it has an incoming, in-progress migration d1dedd3d-61c0-4787-932d-88963e592c50. Migration status is post-migrating {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 15:26:50 user nova-compute[74421]: INFO nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating resource usage from migration d1dedd3d-61c0-4787-932d-88963e592c50
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 95dc4c72-5e91-4666-a31b-037e690c0e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 87052596-1511-45a7-9c61-ec1631102126 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Migration d1dedd3d-61c0-4787-932d-88963e592c50 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-b5afa831-c4ec-407e-bc39-217cbe6eea5b req-99ee2c02-30ab-4c99-84f4-421e02965658 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b5afa831-c4ec-407e-bc39-217cbe6eea5b req-99ee2c02-30ab-4c99-84f4-421e02965658 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b5afa831-c4ec-407e-bc39-217cbe6eea5b req-99ee2c02-30ab-4c99-84f4-421e02965658 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b5afa831-c4ec-407e-bc39-217cbe6eea5b req-99ee2c02-30ab-4c99-84f4-421e02965658 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-b5afa831-c4ec-407e-bc39-217cbe6eea5b req-99ee2c02-30ab-4c99-84f4-421e02965658 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:50 user nova-compute[74421]: WARNING nova.compute.manager [req-b5afa831-c4ec-407e-bc39-217cbe6eea5b req-99ee2c02-30ab-4c99-84f4-421e02965658 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state rescued and task_state None.
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:50 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:26:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.748s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-changed-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing instance network info cache due to event network-changed-8f1298c0-12d7-4385-8d96-529658cbd8bf. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:26:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] Acquiring lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] Acquired lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:52 user nova-compute[74421]: DEBUG nova.network.neutron [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Refreshing network info cache for port 8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:26:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updated VIF entry in instance network info cache for port 8f1298c0-12d7-4385-8d96-529658cbd8bf. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:26:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-369efa52-11ab-487c-864b-846cd8a7528b req-8442b1e1-38b5-4e7b-8fa8-7a38fa86bd76 service nova] Releasing lock "refresh_cache-87052596-1511-45a7-9c61-ec1631102126" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:26:54 user nova-compute[74421]: INFO nova.compute.claims [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Claim successful on node user
Oct 23 15:26:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:26:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.policy [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfeb2fd3197444f89abc351a2ac1dfa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf1350aabad4540a2afb76a166a3a0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "87052596-1511-45a7-9c61-ec1631102126" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:55 user nova-compute[74421]: INFO nova.compute.manager [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Terminating instance
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:26:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Creating image(s)
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "/opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "/opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.256s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.285s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk 1073741824" returned: 0 in 0.098s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.388s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-982ac4e9-204f-4236-8b7c-b69db99899c2 req-fa3d2a43-5138-48d4-8511-dac6ce78ecc7 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-982ac4e9-204f-4236-8b7c-b69db99899c2 req-fa3d2a43-5138-48d4-8511-dac6ce78ecc7 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-982ac4e9-204f-4236-8b7c-b69db99899c2 req-fa3d2a43-5138-48d4-8511-dac6ce78ecc7 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-982ac4e9-204f-4236-8b7c-b69db99899c2 req-fa3d2a43-5138-48d4-8511-dac6ce78ecc7 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-982ac4e9-204f-4236-8b7c-b69db99899c2 req-fa3d2a43-5138-48d4-8511-dac6ce78ecc7 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-982ac4e9-204f-4236-8b7c-b69db99899c2 req-fa3d2a43-5138-48d4-8511-dac6ce78ecc7 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-80218b4d-edd8-4f57-9d04-2ea0a9b061c6 req-1457924b-3bb8-4485-a7bf-044caa6d9abb service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-80218b4d-edd8-4f57-9d04-2ea0a9b061c6 req-1457924b-3bb8-4485-a7bf-044caa6d9abb service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-80218b4d-edd8-4f57-9d04-2ea0a9b061c6 req-1457924b-3bb8-4485-a7bf-044caa6d9abb service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-80218b4d-edd8-4f57-9d04-2ea0a9b061c6 req-1457924b-3bb8-4485-a7bf-044caa6d9abb service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-80218b4d-edd8-4f57-9d04-2ea0a9b061c6 req-1457924b-3bb8-4485-a7bf-044caa6d9abb service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-80218b4d-edd8-4f57-9d04-2ea0a9b061c6 req-1457924b-3bb8-4485-a7bf-044caa6d9abb service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-8f1298c0-12d7-4385-8d96-529658cbd8bf for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.318s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Successfully created port: a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Cannot resize image /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Ensure instance console log exists: /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-96ac8aea-42a7-4560-a125-9a767a1881be req-66762604-1d9c-4355-a034-36fbe220ca58 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96ac8aea-42a7-4560-a125-9a767a1881be req-66762604-1d9c-4355-a034-36fbe220ca58 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96ac8aea-42a7-4560-a125-9a767a1881be req-66762604-1d9c-4355-a034-36fbe220ca58 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96ac8aea-42a7-4560-a125-9a767a1881be req-66762604-1d9c-4355-a034-36fbe220ca58 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-96ac8aea-42a7-4560-a125-9a767a1881be req-66762604-1d9c-4355-a034-36fbe220ca58 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-96ac8aea-42a7-4560-a125-9a767a1881be req-66762604-1d9c-4355-a034-36fbe220ca58 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-854534dd-636d-4e62-af3d-9fd900fe1d78 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:57 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 87052596-1511-45a7-9c61-ec1631102126] Instance destroyed successfully.
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lazy-loading 'resources' on Instance uuid 87052596-1511-45a7-9c61-ec1631102126 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1298c0-12, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e96ed981-30ab-40c6-899e-26d9c6b76a67) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:d7:13,bridge_name='br-int',has_traffic_filtering=True,id=8f1298c0-12d7-4385-8d96-529658cbd8bf,network=Network(dab213e2-4bc0-4980-83c9-380e0bb2304a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1298c0-12')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c372a91-7b, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37e89969-3345-43e2-b131-2c5d729e350c) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Successfully updated port: a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:90:6c,bridge_name='br-int',has_traffic_filtering=True,id=1c372a91-7b22-4ec5-8c58-d90c25f64a8f,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c372a91-7b')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb80e5cc8-69, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquired lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f05b7899-f251-40a8-ae60-386ace49751f) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:47:86,bridge_name='br-int',has_traffic_filtering=True,id=b80e5cc8-6976-44d5-86b4-8ba0a1751053,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb80e5cc8-69')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffb51a57-11, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e55068f-9848-49b5-800b-2f688f558268) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=ffb51a57-114d-4445-b91b-bf80fae1e3a3,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb51a57-11')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "854534dd-636d-4e62-af3d-9fd900fe1d78", "address": "fa:16:3e:70:24:ea", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854534dd-63", "ovs_interfaceid": "854534dd-636d-4e62-af3d-9fd900fe1d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap854534dd-63, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02508948-1973-4046-a5cf-f73320245f2a) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:24:ea,bridge_name='br-int',has_traffic_filtering=True,id=854534dd-636d-4e62-af3d-9fd900fe1d78,network=Network(01326a43-c6b5-4b30-9ba0-dbf1ec3ff514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854534dd-63')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap481adf48-b5, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5be93ea-0b2b-434c-b859-624d8a03c6bf) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1d:4b,bridge_name='br-int',has_traffic_filtering=True,id=481adf48-b512-49e3-abd7-e074512d979d,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481adf48-b5')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873486424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873486424',id=11,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpmGg250WY7zrvhJA3evCBufLUBXN/19nHL9Xifoa4sV8O1vQo8JNQeuMC9Jjxhz7JS0zv4ijntmlo3jd5G9LzjHkvs4RICFGWTobhmTEVK/xfHmQv5Wdozi4QLpz3gdQ==',key_name='tempest-keypair-2079212841',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d8aab7a419a413b95836ec9f86e9a3c',ramdisk_id='',reservation_id='r-e0pwkp3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-131439389',owner_user_name='tempest-TaggedBootDevicesTest-131439389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17260e98ec464f34a1b55bae41d214c3',uuid=87052596-1511-45a7-9c61-ec1631102126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converting VIF {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd67be639-fd, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8ebf1de-54b4-4f71-9163-120ffa6b36d0) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:7d:7f,bridge_name='br-int',has_traffic_filtering=True,id=d67be639-fd23-4ae1-b53f-f54208efd988,network=Network(c6cc5142-d3fd-437c-a3f9-edd6b369f100),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd67be639-fd')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQXClwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:58 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba98f266-cda7-4742-839f-a20a93b04aa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:26:58 user nova-compute[74421]: No targets found.
Oct 23 15:26:58 user nova-compute[74421]: iSNS:
Oct 23 15:26:58 user nova-compute[74421]: No targets found.
Oct 23 15:26:58 user nova-compute[74421]: STATIC:
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:26:58 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:58 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:58 user nova-compute[74421]: FIRMWARE:
Oct 23 15:26:58 user nova-compute[74421]: No targets found.
Oct 23 15:26:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:26:58 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:26:58 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: WARNING nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-b80e5cc8-6976-44d5-86b4-8ba0a1751053 for instance with vm_state active and task_state deleting.
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: WARNING nova.compute.manager [req-d268bb72-df66-4518-8603-4269a5915049 req-c833e86e-d4df-4706-81ce-23e2ea4973f4 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-ffb51a57-114d-4445-b91b-bf80fae1e3a3 for instance with vm_state active and task_state deleting.
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f889ac03-a19f-451b-953d-1acf3cb3ce18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: WARNING nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-8f1298c0-12d7-4385-8d96-529658cbd8bf for instance with vm_state active and task_state deleting.
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: WARNING nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-1c372a91-7b22-4ec5-8c58-d90c25f64a8f for instance with vm_state active and task_state deleting.
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-481adf48-b512-49e3-abd7-e074512d979d for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-changed-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Refreshing instance network info cache due to event network-changed-a15077ef-9a7b-4306-b4df-5372bc63876e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[72974a85-e7d7-4bdd-917a-06e23438c017]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 (non-flash)
Oct 23 15:26:58 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24784c72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8'): ({'sdg'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Removing single pathed devices sdg {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[49987203-312d-4816-8f38-08bde2ed5719]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[296365d1-963c-4dba-973e-7927249e4da7]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Flushing IO for device /dev/sdg {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b727c9a1-1ecc-4b2f-9fc4-f0188f20fa2b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updating instance_info_cache with network_info: [{"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Releasing lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Instance network_info: |[{"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquired lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Refreshing network info cache for port a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Start _get_guest_xml network_info=[{"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.061s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b64ec9-26d9-4293-a6cd-93e1704ac430]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] SCSI volumes sdg have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1916891573',display_name='tempest-VolumesAdminNegativeTest-server-1916891573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1916891573',id=17,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKalKZ1NBBEKeOW8MEpwEcMgFoa4H0aPCCYuEwjw1GAIVDXMehIaRqfQAsMTlVxtZt4P8FHgdmoOc50CIKU/weyTXCaarqCuYNGS5azQ3Ycf54vBNAB4EFdfsi293z6zxg==',key_name='tempest-keypair-157743316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf1350aabad4540a2afb76a166a3a0e',ramdisk_id='',reservation_id='r-9so2wfuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1598499002',owner_user_name='tempest-VolumesAdminNegativeTest-1598499002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfeb2fd3197444f89abc351a2ac1dfa6',uuid=ef24f4fa-32df-438e-bb56-ee4a0b32770c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converting VIF {"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'pci_devices' on Instance uuid ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e6943-7f40-4bc2-992f-d8ad54143545]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:26:58 user nova-compute[74421]:   <uuid>ef24f4fa-32df-438e-bb56-ee4a0b32770c</uuid>
Oct 23 15:26:58 user nova-compute[74421]:   <name>instance-00000011</name>
Oct 23 15:26:58 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:26:58 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:26:58 user nova-compute[74421]:   <metadata>
Oct 23 15:26:58 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:26:58 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:26:58 user nova-compute[74421]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1916891573</nova:name>
Oct 23 15:26:58 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:26:58</nova:creationTime>
Oct 23 15:26:58 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:26:58 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:26:58 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:26:58 user nova-compute[74421]:       <nova:owner>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:user uuid="bfeb2fd3197444f89abc351a2ac1dfa6">tempest-VolumesAdminNegativeTest-1598499002-project-member</nova:user>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:project uuid="fdf1350aabad4540a2afb76a166a3a0e">tempest-VolumesAdminNegativeTest-1598499002</nova:project>
Oct 23 15:26:58 user nova-compute[74421]:       </nova:owner>
Oct 23 15:26:58 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:26:58 user nova-compute[74421]:       <nova:ports>
Oct 23 15:26:58 user nova-compute[74421]:         <nova:port uuid="a15077ef-9a7b-4306-b4df-5372bc63876e">
Oct 23 15:26:58 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 15:26:58 user nova-compute[74421]:         </nova:port>
Oct 23 15:26:58 user nova-compute[74421]:       </nova:ports>
Oct 23 15:26:58 user nova-compute[74421]:     </nova:instance>
Oct 23 15:26:58 user nova-compute[74421]:   </metadata>
Oct 23 15:26:58 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:26:58 user nova-compute[74421]:     <system>
Oct 23 15:26:58 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:26:58 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:26:58 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:26:58 user nova-compute[74421]:       <entry name="serial">ef24f4fa-32df-438e-bb56-ee4a0b32770c</entry>
Oct 23 15:26:58 user nova-compute[74421]:       <entry name="uuid">ef24f4fa-32df-438e-bb56-ee4a0b32770c</entry>
Oct 23 15:26:58 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:26:58 user nova-compute[74421]:     </system>
Oct 23 15:26:58 user nova-compute[74421]:   </sysinfo>
Oct 23 15:26:58 user nova-compute[74421]:   <os>
Oct 23 15:26:58 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:26:58 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:26:58 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:26:58 user nova-compute[74421]:   </os>
Oct 23 15:26:58 user nova-compute[74421]:   <features>
Oct 23 15:26:58 user nova-compute[74421]:     <acpi/>
Oct 23 15:26:58 user nova-compute[74421]:     <apic/>
Oct 23 15:26:58 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:26:58 user nova-compute[74421]:   </features>
Oct 23 15:26:58 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:26:58 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:26:58 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:26:58 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:26:58 user nova-compute[74421]:   </clock>
Oct 23 15:26:58 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:26:58 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:26:58 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:26:58 user nova-compute[74421]:   </cpu>
Oct 23 15:26:58 user nova-compute[74421]:   <devices>
Oct 23 15:26:58 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:26:58 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:26:58 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk"/>
Oct 23 15:26:58 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:26:58 user nova-compute[74421]:     </disk>
Oct 23 15:26:58 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:26:58 user nova-compute[74421]:       <mac address="fa:16:3e:ca:4c:2a"/>
Oct 23 15:26:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:58 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:26:58 user nova-compute[74421]:       <target dev="tapa15077ef-9a"/>
Oct 23 15:26:58 user nova-compute[74421]:     </interface>
Oct 23 15:26:58 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:26:58 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/console.log" append="off"/>
Oct 23 15:26:58 user nova-compute[74421]:     </serial>
Oct 23 15:26:58 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:26:58 user nova-compute[74421]:     <video>
Oct 23 15:26:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:26:58 user nova-compute[74421]:     </video>
Oct 23 15:26:58 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:26:58 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:26:58 user nova-compute[74421]:     </rng>
Oct 23 15:26:58 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:26:58 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:26:58 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:26:58 user nova-compute[74421]:     </memballoon>
Oct 23 15:26:58 user nova-compute[74421]:   </devices>
Oct 23 15:26:58 user nova-compute[74421]: </domain>
Oct 23 15:26:58 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1916891573',display_name='tempest-VolumesAdminNegativeTest-server-1916891573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1916891573',id=17,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKalKZ1NBBEKeOW8MEpwEcMgFoa4H0aPCCYuEwjw1GAIVDXMehIaRqfQAsMTlVxtZt4P8FHgdmoOc50CIKU/weyTXCaarqCuYNGS5azQ3Ycf54vBNAB4EFdfsi293z6zxg==',key_name='tempest-keypair-157743316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf1350aabad4540a2afb76a166a3a0e',ramdisk_id='',reservation_id='r-9so2wfuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1598499002',owner_user_name='tempest-VolumesAdminNegativeTest-1598499002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfeb2fd3197444f89abc351a2ac1dfa6',uuid=ef24f4fa-32df-438e-bb56-ee4a0b32770c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converting VIF {"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_vif [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4afdab89-1b94-5361-8922-e8c5f2ca756e', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa15077ef-9a, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa15077ef-9a, col_values=(('qos', UUID('9c1ef0cb-b1f5-4e63-9087-af01fd737e4f')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa15077ef-9a, col_values=(('external_ids', {'iface-id': 'a15077ef-9a7b-4306-b4df-5372bc63876e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:4c:2a', 'vm-uuid': 'ef24f4fa-32df-438e-bb56-ee4a0b32770c'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:58 user nova-compute[74421]: INFO os_vif [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a')
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[28707c7d-90b7-4adc-8270-483a651eae98]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260]
Oct 23 15:26:58 user nova-compute[74421]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8, portal: 172.16.0.220,3260] successful.
Oct 23 15:26:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:26:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No VIF found with MAC fa:16:3e:ca:4c:2a, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823c542-166b-4a0a-bba8-de97ef0885d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cf4f68-84ba-4e34-95fc-1dc0b73f5628]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== disconnect_volume: return (485ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmpBizhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[12156d51-a12f-4a93-bd90-f5db19aa8255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:26:59 user nova-compute[74421]: No targets found.
Oct 23 15:26:59 user nova-compute[74421]: iSNS:
Oct 23 15:26:59 user nova-compute[74421]: No targets found.
Oct 23 15:26:59 user nova-compute[74421]: STATIC:
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: FIRMWARE:
Oct 23 15:26:59 user nova-compute[74421]: No targets found.
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:26:59 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:26:59 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dc0cf8-73a8-453c-b0e0-6609a91106f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[469d7202-8703-4fd4-8e23-7a4c3e7bd440]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a (non-flash)
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24783afd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccaf9a0-8f1d-46fd-9f15-b189d8451abd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04710345-b747-4c87-9a65-4f19c86841d6]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedf6480-81a8-40bd-9d78-7e4793b6c9f0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[71215ee9-381f-4fb8-8885-514b73818c75]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba85d50-329c-47d2-87b5-d1310534cdef]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updated VIF entry in instance network info cache for port a15077ef-9a7b-4306-b4df-5372bc63876e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updating instance_info_cache with network_info: [{"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Releasing lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:59 user nova-compute[74421]: WARNING nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-481adf48-b512-49e3-abd7-e074512d979d for instance with vm_state active and task_state deleting.
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-unplugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f5d088a-9b10-4278-bcfe-a6b43d3fcac2 req-75fc7f5f-e5ee-4f4b-b963-8c1461e86e24 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-unplugged-d67be639-fd23-4ae1-b53f-f54208efd988 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c393bb-f9d6-4e11-ac92-3ee4173860b7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260]
Oct 23 15:26:59 user nova-compute[74421]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a, portal: 172.16.0.220,3260] successful.
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-d254c8fa-2382-42a4-9b69-c8fdbf9dddbd req-b81df574-84c9-4580-88a3-e6dd4a39c77d service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d254c8fa-2382-42a4-9b69-c8fdbf9dddbd req-b81df574-84c9-4580-88a3-e6dd4a39c77d service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d254c8fa-2382-42a4-9b69-c8fdbf9dddbd req-b81df574-84c9-4580-88a3-e6dd4a39c77d service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d254c8fa-2382-42a4-9b69-c8fdbf9dddbd req-b81df574-84c9-4580-88a3-e6dd4a39c77d service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-d254c8fa-2382-42a4-9b69-c8fdbf9dddbd req-b81df574-84c9-4580-88a3-e6dd4a39c77d service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:26:59 user nova-compute[74421]: WARNING nova.compute.manager [req-d254c8fa-2382-42a4-9b69-c8fdbf9dddbd req-b81df574-84c9-4580-88a3-e6dd4a39c77d service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-854534dd-636d-4e62-af3d-9fd900fe1d78 for instance with vm_state active and task_state deleting.
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce683976-8617-4a06-b859-9cd386d2951a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b936711-ae9e-4ce9-868b-aee4c100f3e3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== disconnect_volume: return (368ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZYyhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:26:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a75690-5dc0-488d-ae42-7dccfd5a5c3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:26:59 user nova-compute[74421]: No targets found.
Oct 23 15:26:59 user nova-compute[74421]: iSNS:
Oct 23 15:26:59 user nova-compute[74421]: No targets found.
Oct 23 15:26:59 user nova-compute[74421]: STATIC:
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:26:59 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:26:59 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:26:59 user nova-compute[74421]: FIRMWARE:
Oct 23 15:26:59 user nova-compute[74421]: No targets found.
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:26:59 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:26:59 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be61af-9428-45a9-9e2a-61f0811efbf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321fab3-dd59-4331-a54e-1579987e16c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24784c70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d59f13-8dfb-43a7-b976-cd2b602ab15d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05be169-d20e-43b8-bdb6-a197d55acb85]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5887fa5-91e1-4ddd-aa28-e06e6a705819]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc313e58-0fb0-4e8b-bc4b-c542b77cc808]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a48a1-10e2-4a92-b7ab-09fb5ea279c4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7976bfc6-14a9-4255-ae00-26cd582adcbe]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260]
Oct 23 15:26:59 user nova-compute[74421]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d, portal: 172.16.0.220,3260] successful.
Oct 23 15:26:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7321a0-478d-4bb2-81a5-3c226c2eb42d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5348b82-cfd6-402c-acdd-d64c069e1c19]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] <== disconnect_volume: return (420ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:26:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:26:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Deleting instance files /opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126_del
Oct 23 15:26:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Deletion of /opt/stack/data/nova/instances/87052596-1511-45a7-9c61-ec1631102126_del complete
Oct 23 15:27:00 user nova-compute[74421]: INFO nova.compute.manager [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Took 4.34 seconds to destroy the instance on the hypervisor.
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 87052596-1511-45a7-9c61-ec1631102126] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 87052596-1511-45a7-9c61-ec1631102126] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-4b360fbb-987d-498d-858b-6ce9b4824f47 req-21c5bf9f-8216-4531-ae81-92b03bfa4d74 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4b360fbb-987d-498d-858b-6ce9b4824f47 req-21c5bf9f-8216-4531-ae81-92b03bfa4d74 service nova] Acquiring lock "87052596-1511-45a7-9c61-ec1631102126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4b360fbb-987d-498d-858b-6ce9b4824f47 req-21c5bf9f-8216-4531-ae81-92b03bfa4d74 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4b360fbb-987d-498d-858b-6ce9b4824f47 req-21c5bf9f-8216-4531-ae81-92b03bfa4d74 service nova] Lock "87052596-1511-45a7-9c61-ec1631102126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-4b360fbb-987d-498d-858b-6ce9b4824f47 req-21c5bf9f-8216-4531-ae81-92b03bfa4d74 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] No waiting events found dispatching network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:00 user nova-compute[74421]: WARNING nova.compute.manager [req-4b360fbb-987d-498d-858b-6ce9b4824f47 req-21c5bf9f-8216-4531-ae81-92b03bfa4d74 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received unexpected event network-vif-plugged-d67be639-fd23-4ae1-b53f-f54208efd988 for instance with vm_state active and task_state deleting.
Oct 23 15:27:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-c34fa0f1-d364-402d-adde-9510b8609ca9 req-04ec406e-457c-46d6-9d44-32a56d2e818c service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c34fa0f1-d364-402d-adde-9510b8609ca9 req-04ec406e-457c-46d6-9d44-32a56d2e818c service nova] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c34fa0f1-d364-402d-adde-9510b8609ca9 req-04ec406e-457c-46d6-9d44-32a56d2e818c service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c34fa0f1-d364-402d-adde-9510b8609ca9 req-04ec406e-457c-46d6-9d44-32a56d2e818c service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-c34fa0f1-d364-402d-adde-9510b8609ca9 req-04ec406e-457c-46d6-9d44-32a56d2e818c service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] No waiting events found dispatching network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:00 user nova-compute[74421]: WARNING nova.compute.manager [req-c34fa0f1-d364-402d-adde-9510b8609ca9 req-04ec406e-457c-46d6-9d44-32a56d2e818c service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received unexpected event network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e for instance with vm_state building and task_state spawning.
Oct 23 15:27:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:27:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Instance spawned successfully.
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:02 user nova-compute[74421]: INFO nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Took 7.25 seconds to spawn the instance on the hypervisor.
Oct 23 15:27:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-c43d9110-1685-4a4c-81b3-78e02c138ca3 req-56a0f71b-2c52-4358-96cb-b88b0e0b4000 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c43d9110-1685-4a4c-81b3-78e02c138ca3 req-56a0f71b-2c52-4358-96cb-b88b0e0b4000 service nova] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c43d9110-1685-4a4c-81b3-78e02c138ca3 req-56a0f71b-2c52-4358-96cb-b88b0e0b4000 service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c43d9110-1685-4a4c-81b3-78e02c138ca3 req-56a0f71b-2c52-4358-96cb-b88b0e0b4000 service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-c43d9110-1685-4a4c-81b3-78e02c138ca3 req-56a0f71b-2c52-4358-96cb-b88b0e0b4000 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] No waiting events found dispatching network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:03 user nova-compute[74421]: WARNING nova.compute.manager [req-c43d9110-1685-4a4c-81b3-78e02c138ca3 req-56a0f71b-2c52-4358-96cb-b88b0e0b4000 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received unexpected event network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e for instance with vm_state building and task_state spawning.
Oct 23 15:27:03 user nova-compute[74421]: INFO nova.compute.manager [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Took 8.42 seconds to build instance.
Oct 23 15:27:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded375b9-0cc9-41ca-b1cb-596bad85fad2 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.678s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-d00016e4-6f98-44f0-b919-9a87e8f32466 req-05a19413-6549-4f59-89b5-70987bc56e9b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-deleted-854534dd-636d-4e62-af3d-9fd900fe1d78 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:03 user nova-compute[74421]: INFO nova.compute.manager [req-d00016e4-6f98-44f0-b919-9a87e8f32466 req-05a19413-6549-4f59-89b5-70987bc56e9b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Neutron deleted interface 854534dd-636d-4e62-af3d-9fd900fe1d78; detaching it from the instance and deleting it from the info cache
Oct 23 15:27:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-d00016e4-6f98-44f0-b919-9a87e8f32466 req-05a19413-6549-4f59-89b5-70987bc56e9b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "address": "fa:16:3e:ea:d7:13", "network": {"id": "dab213e2-4bc0-4980-83c9-380e0bb2304a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2066438797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1298c0-12", "ovs_interfaceid": "8f1298c0-12d7-4385-8d96-529658cbd8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-d00016e4-6f98-44f0-b919-9a87e8f32466 req-05a19413-6549-4f59-89b5-70987bc56e9b service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Detach interface failed, port_id=854534dd-636d-4e62-af3d-9fd900fe1d78, reason: Instance 87052596-1511-45a7-9c61-ec1631102126 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:27:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-deleted-8f1298c0-12d7-4385-8d96-529658cbd8bf {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:05 user nova-compute[74421]: INFO nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Neutron deleted interface 8f1298c0-12d7-4385-8d96-529658cbd8bf; detaching it from the instance and deleting it from the info cache
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "address": "fa:16:3e:27:b7:8a", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb51a57-11", "ovs_interfaceid": "ffb51a57-114d-4445-b91b-bf80fae1e3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Detach interface failed, port_id=8f1298c0-12d7-4385-8d96-529658cbd8bf, reason: Instance 87052596-1511-45a7-9c61-ec1631102126 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-deleted-ffb51a57-114d-4445-b91b-bf80fae1e3a3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:05 user nova-compute[74421]: INFO nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Neutron deleted interface ffb51a57-114d-4445-b91b-bf80fae1e3a3; detaching it from the instance and deleting it from the info cache
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "481adf48-b512-49e3-abd7-e074512d979d", "address": "fa:16:3e:76:1d:4b", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481adf48-b5", "ovs_interfaceid": "481adf48-b512-49e3-abd7-e074512d979d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Detach interface failed, port_id=ffb51a57-114d-4445-b91b-bf80fae1e3a3, reason: Instance 87052596-1511-45a7-9c61-ec1631102126 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-deleted-481adf48-b512-49e3-abd7-e074512d979d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:05 user nova-compute[74421]: INFO nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Neutron deleted interface 481adf48-b512-49e3-abd7-e074512d979d; detaching it from the instance and deleting it from the info cache
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Updating instance_info_cache with network_info: [{"id": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "address": "fa:16:3e:b9:90:6c", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c372a91-7b", "ovs_interfaceid": "1c372a91-7b22-4ec5-8c58-d90c25f64a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "address": "fa:16:3e:4c:47:86", "network": {"id": "01326a43-c6b5-4b30-9ba0-dbf1ec3ff514", "bridge": "br-int", "label": "tempest-device-tagging-net1-1730363686", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80e5cc8-69", "ovs_interfaceid": "b80e5cc8-6976-44d5-86b4-8ba0a1751053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d67be639-fd23-4ae1-b53f-f54208efd988", "address": "fa:16:3e:d2:7d:7f", "network": {"id": "c6cc5142-d3fd-437c-a3f9-edd6b369f100", "bridge": "br-int", "label": "tempest-device-tagging-net2-1841161782", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d8aab7a419a413b95836ec9f86e9a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd67be639-fd", "ovs_interfaceid": "d67be639-fd23-4ae1-b53f-f54208efd988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:05 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 87052596-1511-45a7-9c61-ec1631102126] Took 5.37 seconds to deallocate network for instance.
Oct 23 15:27:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-d445ab42-6181-4ee1-b362-b24beb444822 req-c920f288-12f7-49f6-b350-5bf54941a898 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Detach interface failed, port_id=481adf48-b512-49e3-abd7-e074512d979d, reason: Instance 87052596-1511-45a7-9c61-ec1631102126 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:07 user nova-compute[74421]: INFO nova.compute.manager [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Detaching volume 0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:27:07 user nova-compute[74421]: INFO nova.virt.block_device [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Attempting to driver detach volume 0cc03a24-8c38-4c17-a67f-3f3c2c31e141 from mountpoint /dev/vdb
Oct 23 15:27:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Attempting to detach device vdb from instance 95dc4c72-5e91-4666-a31b-037e690c0e6d from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:27:07 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:27:07 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:27:07 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:27:07 user nova-compute[74421]:   <serial>0cc03a24-8c38-4c17-a67f-3f3c2c31e141</serial>
Oct 23 15:27:07 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:27:07 user nova-compute[74421]: </disk>
Oct 23 15:27:07 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:27:07 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully detached device vdb from instance 95dc4c72-5e91-4666-a31b-037e690c0e6d from the persistent domain config.
Oct 23 15:27:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95dc4c72-5e91-4666-a31b-037e690c0e6d from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:27:07 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:27:07 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:27:07 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:27:07 user nova-compute[74421]:   <serial>0cc03a24-8c38-4c17-a67f-3f3c2c31e141</serial>
Oct 23 15:27:07 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:27:07 user nova-compute[74421]: </disk>
Oct 23 15:27:07 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-46812a00-e3b0-4951-ac51-9c8c89807bf4 req-f3b6d62b-01b4-42d2-916f-8ee104ed8536 service nova] [instance: 87052596-1511-45a7-9c61-ec1631102126] Received event network-vif-deleted-d67be639-fd23-4ae1-b53f-f54208efd988 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95dc4c72-5e91-4666-a31b-037e690c0e6d {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:27:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:10 user nova-compute[74421]: INFO nova.compute.manager [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] [instance: 87052596-1511-45a7-9c61-ec1631102126] Took 4.91 seconds to detach 3 volumes for instance.
Oct 23 15:27:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:10 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:27:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:27:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:10 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Deleted allocations for instance 87052596-1511-45a7-9c61-ec1631102126
Oct 23 15:27:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ea14388a-6e05-4573-9616-0444c518706f tempest-TaggedBootDevicesTest-131439389 tempest-TaggedBootDevicesTest-131439389-project-member] Lock "87052596-1511-45a7-9c61-ec1631102126" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.353s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-changed-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Refreshing instance network info cache due to event network-changed-05470b57-eedc-49e7-b83d-6ae2db174534. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:27:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] Acquiring lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:27:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] Acquired lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:27:23 user nova-compute[74421]: DEBUG nova.network.neutron [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Refreshing network info cache for port 05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'flavor' on Instance uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:24 user nova-compute[74421]: INFO nova.compute.manager [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attaching volume 60bbdf62-e2ca-4d93-98f0-71b544193882 to /dev/vdb
Oct 23 15:27:24 user nova-compute[74421]: DEBUG os_brick.utils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[89857baa-354a-451d-a63a-8a705f4e2769]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5e17e-1068-4c50-bbab-c3f9d112a994]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[461fd4f4-94ca-43aa-89d8-ec05e3c1e504]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01427dd-0cb2-4bb2-a89e-65c992ef2d80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:27:25 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:27:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d93eb36-5537-484a-93f9-e14cd1d36141]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG os_brick.utils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updating existing volume attachment record: da4ec7a8-3080-46a4-b30c-9b3886576c46 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updated VIF entry in instance network info cache for port 05470b57-eedc-49e7-b83d-6ae2db174534. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updating instance_info_cache with network_info: [{"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9fd93fe2-38cc-4456-b006-93a310ef0984 req-efd7d095-29bf-4877-a447-da041d10d46e service nova] Releasing lock "refresh_cache-0879f788-a600-4bfe-b858-deec2a8b1a51" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:27:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:27 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 95dc4c72-5e91-4666-a31b-037e690c0e6d is timed out.
Oct 23 15:27:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully detached device vdb from instance 95dc4c72-5e91-4666-a31b-037e690c0e6d from the live domain config.
Oct 23 15:27:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJdyGuWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:27:27 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[759698b7-97e0-42b9-8de2-32489895f44a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:27:27 user nova-compute[74421]: No targets found.
Oct 23 15:27:27 user nova-compute[74421]: iSNS:
Oct 23 15:27:27 user nova-compute[74421]: No targets found.
Oct 23 15:27:27 user nova-compute[74421]: STATIC:
Oct 23 15:27:27 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:27:27 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:27 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:27 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141
Oct 23 15:27:27 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:27 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:27 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:27:27 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:27 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:27 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:27:27 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:27 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:27 user nova-compute[74421]: FIRMWARE:
Oct 23 15:27:27 user nova-compute[74421]: No targets found.
Oct 23 15:27:27 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:27:27 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:27:27 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7ab4cb-381a-4eef-b463-25f97aa42388]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c5d15-0df9-4f2d-ac79-166781631d8c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:27:27 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:27:27 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:27:27 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:27:27 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:27:27 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:27:27 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:27:27 user nova-compute[74421]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 (non-flash)
Oct 23 15:27:27 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247833e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1113db-e815-4270-9b40-9da25f40b8cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79d647-4f12-4a95-bfa9-2e54964316de]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b26604-f3c6-4b41-bb18-425aabf3cc68]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852f37e-afcb-41f6-8a57-3bfdb6d7a7af]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7711a57e-196b-4e7c-8b77-970c4068c00c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:27:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[28129af7-ab52-4a51-857e-d74aff1a2930]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260]
Oct 23 15:27:28 user nova-compute[74421]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141, portal: 172.16.0.220,3260] successful.
Oct 23 15:27:28 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc03a24-8c38-4c17-a67f-3f3c2c31e141 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[78633c49-284a-4f69-8c78-7fc1c8839785]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== disconnect_volume: return (369ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:27:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:29 user nova-compute[74421]: DEBUG nova.objects.instance [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid 95dc4c72-5e91-4666-a31b-037e690c0e6d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:27:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-72abcdaa-867e-4e2c-a095-41b852cd4aee tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.032s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:27:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:27:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:27:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:34 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:27:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:27:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:27:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:27:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:27:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:27:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:27:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:27:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:41 user nova-compute[74421]: INFO nova.compute.manager [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Terminating instance
Oct 23 15:27:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-72be73ca-4198-4092-a041-d844b2bfb191 req-7ee21eb2-5f3d-4e9f-93d7-dd87cdeee678 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-unplugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-72be73ca-4198-4092-a041-d844b2bfb191 req-7ee21eb2-5f3d-4e9f-93d7-dd87cdeee678 service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-72be73ca-4198-4092-a041-d844b2bfb191 req-7ee21eb2-5f3d-4e9f-93d7-dd87cdeee678 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-72be73ca-4198-4092-a041-d844b2bfb191 req-7ee21eb2-5f3d-4e9f-93d7-dd87cdeee678 service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-72be73ca-4198-4092-a041-d844b2bfb191 req-7ee21eb2-5f3d-4e9f-93d7-dd87cdeee678 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-unplugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-72be73ca-4198-4092-a041-d844b2bfb191 req-7ee21eb2-5f3d-4e9f-93d7-dd87cdeee678 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-unplugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:27:42 user nova-compute[74421]: INFO nova.compute.claims [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Claim successful on node user
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Instance destroyed successfully.
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lazy-loading 'resources' on Instance uuid 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1503561539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1799553775',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO75MIGajf4Vw0rXTyRtpSg+qnILL/OJtrCnJSVMDBhv5R1AbedUiPG4/up8ZrSFTDr6ikRP14S05M5xhw0sRohywM06zWPRCpRMWEriANOZNXkKi6kDB6U7/eSItRBg3A==',key_name='tempest-keypair-1846128662',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9f258e8819140888feb117e19e1758b',ramdisk_id='',reservation_id='r-cbzjtcm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-595791159',owner_user_name='tempest-ServerActionsV293TestJSON-595791159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b95c80b39db4d168440aea6ba214333',uuid=46cfd9e6-88d4-48ee-af46-ab81bfcabd23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converting VIF {"id": "92806353-ba4b-4e20-b238-cf6d08443a8b", "address": "fa:16:3e:81:63:37", "network": {"id": "92ae43a1-4560-4949-ba4d-c3a5b8b95617", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1836749890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9f258e8819140888feb117e19e1758b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92806353-ba", "ovs_interfaceid": "92806353-ba4b-4e20-b238-cf6d08443a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_vif [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92806353-ba, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc635f88-34cf-47bc-a8e6-697fbc60cc55) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:42 user nova-compute[74421]: INFO os_vif [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:63:37,bridge_name='br-int',has_traffic_filtering=True,id=92806353-ba4b-4e20-b238-cf6d08443a8b,network=Network(92ae43a1-4560-4949-ba4d-c3a5b8b95617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92806353-ba')
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFlRmYen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:27:42 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba946013-68e8-4449-9b00-0bf0c863f1f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:27:42 user nova-compute[74421]: No targets found.
Oct 23 15:27:42 user nova-compute[74421]: iSNS:
Oct 23 15:27:42 user nova-compute[74421]: No targets found.
Oct 23 15:27:42 user nova-compute[74421]: STATIC:
Oct 23 15:27:42 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:27:42 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:42 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:42 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f
Oct 23 15:27:42 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:42 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:42 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:27:42 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:27:42 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:27:42 user nova-compute[74421]: FIRMWARE:
Oct 23 15:27:42 user nova-compute[74421]: No targets found.
Oct 23 15:27:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:27:42 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:27:42 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf5b7a-5211-42be-be74-ab0475f16273]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ddb404-dc9b-42e0-9065-ddedef174e33]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:27:42 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:27:42 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:27:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:27:42 user nova-compute[74421]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f (non-flash)
Oct 23 15:27:42 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:27:42 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24800b04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f'): ({'sdf'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Removing single pathed devices sdf {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f83ab3-be29-4d51-ac48-cebbfa92c7c0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf0276-2764-40eb-8466-54ca8d39fde6]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Flushing IO for device /dev/sdf {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8ea04-8f09-4386-bb75-48dad8c362ff]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8184109f-3fff-4d72-bcef-4573b473ac42]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0743e22', '/dev/disk/by-id/scsi-1SCST_BIOf0743e22-9c9a95ca8235f094', '/dev/disk/by-id/scsi-23963396139356361') {{(pid=85617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53f73a-8f01-4c53-9e75-8f829bdd335e]: (4, None) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8723ee2d-fff0-4492-80d6-53e0272ecdf7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:27:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[012f3966-1d37-4098-9378-c012e231eca9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260]
Oct 23 15:27:43 user nova-compute[74421]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f, portal: 172.16.0.220,3260] successful.
Oct 23 15:27:43 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71094d46-9be0-44cb-956e-1779b12eca5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[08072060-324b-41af-9cd3-ecb7ded79f78]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] <== disconnect_volume: return (467ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:27:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Deleting instance files /opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23_del
Oct 23 15:27:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Deletion of /opt/stack/data/nova/instances/46cfd9e6-88d4-48ee-af46-ab81bfcabd23_del complete
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.837s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:27:43 user nova-compute[74421]: INFO nova.compute.manager [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Took 1.48 seconds to destroy the instance on the hypervisor.
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:27:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.policy [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fefe6a440e549e1bf01b83635388a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae443c6dfd6743a4997334b67b1250e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:27:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Creating image(s)
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "/opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "/opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk 1073741824" returned: 0 in 0.156s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Successfully created port: b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-187bd6df-3d8c-4836-9da7-002f1002ea28 req-149190b6-62c3-4cf4-b1fb-1a4f990db53b service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-187bd6df-3d8c-4836-9da7-002f1002ea28 req-149190b6-62c3-4cf4-b1fb-1a4f990db53b service nova] Acquiring lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-187bd6df-3d8c-4836-9da7-002f1002ea28 req-149190b6-62c3-4cf4-b1fb-1a4f990db53b service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-187bd6df-3d8c-4836-9da7-002f1002ea28 req-149190b6-62c3-4cf4-b1fb-1a4f990db53b service nova] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-187bd6df-3d8c-4836-9da7-002f1002ea28 req-149190b6-62c3-4cf4-b1fb-1a4f990db53b service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] No waiting events found dispatching network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:44 user nova-compute[74421]: WARNING nova.compute.manager [req-187bd6df-3d8c-4836-9da7-002f1002ea28 req-149190b6-62c3-4cf4-b1fb-1a4f990db53b service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received unexpected event network-vif-plugged-92806353-ba4b-4e20-b238-cf6d08443a8b for instance with vm_state active and task_state deleting.
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:44 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Took 0.99 seconds to deallocate network for instance.
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-aaba5246-7b71-485a-b0bb-7d1cb06d24e3 req-3edbb270-de69-4b21-899e-8e46c3e6b7f1 service nova] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Received event network-vif-deleted-92806353-ba4b-4e20-b238-cf6d08443a8b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Cannot resize image /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Ensure instance console log exists: /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:27:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Successfully updated port: b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:27:45 user nova-compute[74421]: INFO nova.compute.manager [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Took 1.13 seconds to detach 1 volumes for instance.
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-changed-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Refreshing instance network info cache due to event network-changed-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] Acquiring lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] Acquired lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Refreshing network info cache for port b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] [instance: 46cfd9e6-88d4-48ee-af46-ab81bfcabd23] Deleting volume: 71094d46-9be0-44cb-956e-1779b12eca5f {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:27:45 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:27:45 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.26392364501953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Applying migration context for instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 as it has an incoming, in-progress migration d1dedd3d-61c0-4787-932d-88963e592c50. Migration status is finished {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 15:27:45 user nova-compute[74421]: INFO nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating resource usage from migration d1dedd3d-61c0-4787-932d-88963e592c50
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 95dc4c72-5e91-4666-a31b-037e690c0e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Migration d1dedd3d-61c0-4787-932d-88963e592c50 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef24f4fa-32df-438e-bb56-ee4a0b32770c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-961d2048-f727-42b8-ba27-1bb46dcd7a59 req-ae7f386c-4aaf-4eac-b377-6d920fa56c91 service nova] Releasing lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquired lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:27:45 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.555s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Updating instance_info_cache with network_info: [{"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Releasing lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Instance network_info: |[{"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Start _get_guest_xml network_info=[{"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:27:46 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:27:46 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2127986215',display_name='tempest-TestVolumeSwap-server-2127986215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2127986215',id=18,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj4+G6ZsG1dDbNvRYrAQxUZX0vp+tYcM2H3o9BZX0Lvg5lbwypSR+tMSq9q+U3E7INvM682OqhoX8y0wiMi+f3bLaAPwvZlAY1xf8V028Pbj4E+wQkh2QPy6N0+IhB11g==',key_name='tempest-keypair-1143155814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae443c6dfd6743a4997334b67b1250e2',ramdisk_id='',reservation_id='r-t2xhrcwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-307935136',owner_user_name='tempest-TestVolumeSwap-307935136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fefe6a440e549e1bf01b83635388a00',uuid=5ceb34be-c948-47d5-9efe-11c8e25a7ceb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Converting VIF {"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:27:46 user nova-compute[74421]:   <uuid>5ceb34be-c948-47d5-9efe-11c8e25a7ceb</uuid>
Oct 23 15:27:46 user nova-compute[74421]:   <name>instance-00000012</name>
Oct 23 15:27:46 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:27:46 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:27:46 user nova-compute[74421]:   <metadata>
Oct 23 15:27:46 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:27:46 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:27:46 user nova-compute[74421]:       <nova:name>tempest-TestVolumeSwap-server-2127986215</nova:name>
Oct 23 15:27:46 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:27:46</nova:creationTime>
Oct 23 15:27:46 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:27:46 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:27:46 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:27:46 user nova-compute[74421]:       <nova:owner>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:user uuid="2fefe6a440e549e1bf01b83635388a00">tempest-TestVolumeSwap-307935136-project-member</nova:user>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:project uuid="ae443c6dfd6743a4997334b67b1250e2">tempest-TestVolumeSwap-307935136</nova:project>
Oct 23 15:27:46 user nova-compute[74421]:       </nova:owner>
Oct 23 15:27:46 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:27:46 user nova-compute[74421]:       <nova:ports>
Oct 23 15:27:46 user nova-compute[74421]:         <nova:port uuid="b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d">
Oct 23 15:27:46 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:27:46 user nova-compute[74421]:         </nova:port>
Oct 23 15:27:46 user nova-compute[74421]:       </nova:ports>
Oct 23 15:27:46 user nova-compute[74421]:     </nova:instance>
Oct 23 15:27:46 user nova-compute[74421]:   </metadata>
Oct 23 15:27:46 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:27:46 user nova-compute[74421]:     <system>
Oct 23 15:27:46 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:27:46 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:27:46 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:27:46 user nova-compute[74421]:       <entry name="serial">5ceb34be-c948-47d5-9efe-11c8e25a7ceb</entry>
Oct 23 15:27:46 user nova-compute[74421]:       <entry name="uuid">5ceb34be-c948-47d5-9efe-11c8e25a7ceb</entry>
Oct 23 15:27:46 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:27:46 user nova-compute[74421]:     </system>
Oct 23 15:27:46 user nova-compute[74421]:   </sysinfo>
Oct 23 15:27:46 user nova-compute[74421]:   <os>
Oct 23 15:27:46 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:27:46 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:27:46 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:27:46 user nova-compute[74421]:   </os>
Oct 23 15:27:46 user nova-compute[74421]:   <features>
Oct 23 15:27:46 user nova-compute[74421]:     <acpi/>
Oct 23 15:27:46 user nova-compute[74421]:     <apic/>
Oct 23 15:27:46 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:27:46 user nova-compute[74421]:   </features>
Oct 23 15:27:46 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:27:46 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:27:46 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:27:46 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:27:46 user nova-compute[74421]:   </clock>
Oct 23 15:27:46 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:27:46 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:27:46 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:27:46 user nova-compute[74421]:   </cpu>
Oct 23 15:27:46 user nova-compute[74421]:   <devices>
Oct 23 15:27:46 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:27:46 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:27:46 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk"/>
Oct 23 15:27:46 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:27:46 user nova-compute[74421]:     </disk>
Oct 23 15:27:46 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:27:46 user nova-compute[74421]:       <mac address="fa:16:3e:00:22:57"/>
Oct 23 15:27:46 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:27:46 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:27:46 user nova-compute[74421]:       <target dev="tapb0f9733c-bd"/>
Oct 23 15:27:46 user nova-compute[74421]:     </interface>
Oct 23 15:27:46 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:27:46 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/console.log" append="off"/>
Oct 23 15:27:46 user nova-compute[74421]:     </serial>
Oct 23 15:27:46 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:27:46 user nova-compute[74421]:     <video>
Oct 23 15:27:46 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:27:46 user nova-compute[74421]:     </video>
Oct 23 15:27:46 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:27:46 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:27:46 user nova-compute[74421]:     </rng>
Oct 23 15:27:46 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:27:46 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:27:46 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:27:46 user nova-compute[74421]:     </memballoon>
Oct 23 15:27:46 user nova-compute[74421]:   </devices>
Oct 23 15:27:46 user nova-compute[74421]: </domain>
Oct 23 15:27:46 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2127986215',display_name='tempest-TestVolumeSwap-server-2127986215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2127986215',id=18,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj4+G6ZsG1dDbNvRYrAQxUZX0vp+tYcM2H3o9BZX0Lvg5lbwypSR+tMSq9q+U3E7INvM682OqhoX8y0wiMi+f3bLaAPwvZlAY1xf8V028Pbj4E+wQkh2QPy6N0+IhB11g==',key_name='tempest-keypair-1143155814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae443c6dfd6743a4997334b67b1250e2',ramdisk_id='',reservation_id='r-t2xhrcwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-307935136',owner_user_name='tempest-TestVolumeSwap-307935136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fefe6a440e549e1bf01b83635388a00',uuid=5ceb34be-c948-47d5-9efe-11c8e25a7ceb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Converting VIF {"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG os_vif [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '989fbbe0-ce70-52af-8e38-5248d0a027f3', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0f9733c-bd, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0f9733c-bd, col_values=(('qos', UUID('b9e0648e-1a09-4f94-bc9a-c3a7922b08d5')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0f9733c-bd, col_values=(('external_ids', {'iface-id': 'b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:22:57', 'vm-uuid': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:27:46 user nova-compute[74421]: INFO os_vif [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd')
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] No VIF found with MAC fa:16:3e:00:22:57, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:27:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:46 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Deleted allocations for instance 46cfd9e6-88d4-48ee-af46-ab81bfcabd23
Oct 23 15:27:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b54193e2-a7d0-480d-a322-9a6cc8b981e5 tempest-ServerActionsV293TestJSON-595791159 tempest-ServerActionsV293TestJSON-595791159-project-member] Lock "46cfd9e6-88d4-48ee-af46-ab81bfcabd23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.941s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-bda74a11-0850-423f-8a3c-749d0ca1caa7 req-8d045b72-1769-47d0-986a-c52a5cecbc17 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bda74a11-0850-423f-8a3c-749d0ca1caa7 req-8d045b72-1769-47d0-986a-c52a5cecbc17 service nova] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bda74a11-0850-423f-8a3c-749d0ca1caa7 req-8d045b72-1769-47d0-986a-c52a5cecbc17 service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bda74a11-0850-423f-8a3c-749d0ca1caa7 req-8d045b72-1769-47d0-986a-c52a5cecbc17 service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-bda74a11-0850-423f-8a3c-749d0ca1caa7 req-8d045b72-1769-47d0-986a-c52a5cecbc17 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] No waiting events found dispatching network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:48 user nova-compute[74421]: WARNING nova.compute.manager [req-bda74a11-0850-423f-8a3c-749d0ca1caa7 req-8d045b72-1769-47d0-986a-c52a5cecbc17 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received unexpected event network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d for instance with vm_state building and task_state spawning.
Oct 23 15:27:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:27:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Instance spawned successfully.
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:27:50 user nova-compute[74421]: INFO nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Took 6.69 seconds to spawn the instance on the hypervisor.
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-6c405980-f4c1-40b4-8466-d4f5fee5fff3 req-4ed8bc15-dc0b-43e4-95fa-952076730dd0 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6c405980-f4c1-40b4-8466-d4f5fee5fff3 req-4ed8bc15-dc0b-43e4-95fa-952076730dd0 service nova] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6c405980-f4c1-40b4-8466-d4f5fee5fff3 req-4ed8bc15-dc0b-43e4-95fa-952076730dd0 service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6c405980-f4c1-40b4-8466-d4f5fee5fff3 req-4ed8bc15-dc0b-43e4-95fa-952076730dd0 service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-6c405980-f4c1-40b4-8466-d4f5fee5fff3 req-4ed8bc15-dc0b-43e4-95fa-952076730dd0 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] No waiting events found dispatching network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:50 user nova-compute[74421]: WARNING nova.compute.manager [req-6c405980-f4c1-40b4-8466-d4f5fee5fff3 req-4ed8bc15-dc0b-43e4-95fa-952076730dd0 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received unexpected event network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d for instance with vm_state building and task_state spawning.
Oct 23 15:27:50 user nova-compute[74421]: INFO nova.compute.manager [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Took 8.19 seconds to build instance.
Oct 23 15:27:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b222e4ac-55f2-4e81-8e45-98a03b72da71 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.344s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:57 user nova-compute[74421]: INFO nova.compute.manager [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Terminating instance
Oct 23 15:27:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f2afcc2-275e-453b-a14d-e4d0cf6b25e5 req-407bbc14-19d2-47ca-8575-20ec67e7cc1c service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-vif-unplugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f2afcc2-275e-453b-a14d-e4d0cf6b25e5 req-407bbc14-19d2-47ca-8575-20ec67e7cc1c service nova] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f2afcc2-275e-453b-a14d-e4d0cf6b25e5 req-407bbc14-19d2-47ca-8575-20ec67e7cc1c service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f2afcc2-275e-453b-a14d-e4d0cf6b25e5 req-407bbc14-19d2-47ca-8575-20ec67e7cc1c service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f2afcc2-275e-453b-a14d-e4d0cf6b25e5 req-407bbc14-19d2-47ca-8575-20ec67e7cc1c service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] No waiting events found dispatching network-vif-unplugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:27:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f2afcc2-275e-453b-a14d-e4d0cf6b25e5 req-407bbc14-19d2-47ca-8575-20ec67e7cc1c service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-vif-unplugged-84cc0fa9-3418-448b-9c04-36388db48a87 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:27:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Instance destroyed successfully.
Oct 23 15:27:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'resources' on Instance uuid 95dc4c72-5e91-4666-a31b-037e690c0e6d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1596576925',display_name='tempest-AttachVolumeNegativeTest-server-1596576925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1596576925',id=3,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhsAvJYNEuXrOKDk3axq6msspiCsjU0Sx5X/zA5Vz3szLZawti2YtjatWg2hNr427VOSbLZlZmfd4cq90FhUFpJr1NWo/1kjpgaRLBQX/nvtYxwX9SgqekgFnX8eTHttQ==',key_name='tempest-keypair-1201945346',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-jhhz10f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=95dc4c72-5e91-4666-a31b-037e690c0e6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "84cc0fa9-3418-448b-9c04-36388db48a87", "address": "fa:16:3e:29:d4:84", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cc0fa9-34", "ovs_interfaceid": "84cc0fa9-3418-448b-9c04-36388db48a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG os_vif [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84cc0fa9-34, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1547bb2f-efe6-44d1-a367-3ceb0f8ae699) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:58 user nova-compute[74421]: INFO os_vif [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=84cc0fa9-3418-448b-9c04-36388db48a87,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cc0fa9-34')
Oct 23 15:27:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Deleting instance files /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d_del
Oct 23 15:27:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Deletion of /opt/stack/data/nova/instances/95dc4c72-5e91-4666-a31b-037e690c0e6d_del complete
Oct 23 15:27:58 user nova-compute[74421]: INFO nova.compute.manager [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 23 15:27:58 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:27:58 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:27:59 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:27:59 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Took 0.80 seconds to deallocate network for instance.
Oct 23 15:27:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:27:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:27:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:27:59 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:27:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:27:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:27:59 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Deleted allocations for instance 95dc4c72-5e91-4666-a31b-037e690c0e6d
Oct 23 15:28:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] Acquiring lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] No waiting events found dispatching network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:00 user nova-compute[74421]: WARNING nova.compute.manager [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received unexpected event network-vif-plugged-84cc0fa9-3418-448b-9c04-36388db48a87 for instance with vm_state deleted and task_state None.
Oct 23 15:28:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-5d3b755d-c9ca-42d1-a7af-74ef11c68ccb req-c5ff903e-3c57-4b3f-bef7-83df1e8e0c57 service nova] [instance: 95dc4c72-5e91-4666-a31b-037e690c0e6d] Received event network-vif-deleted-84cc0fa9-3418-448b-9c04-36388db48a87 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4121786b-098f-466c-a693-22b043222422 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "95dc4c72-5e91-4666-a31b-037e690c0e6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Port 7dd217a3-a501-4e28-a7f6-659356f41eca binding to destination host user is already ACTIVE {{(pid=74421) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:02 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:02 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:02 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2743ed-e3fe-4631-a5a9-16283adb6b8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:28:02 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f70c673-2667-4d4b-9a12-8366343545ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882] added
Oct 23 15:28:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b859bfc4-35f8-4e08-8d39-2887936c5c31]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f722238f-59bc-4511-b275-39a478402f7b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-changed-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Refreshing instance network info cache due to event network-changed-e31e3015-9410-4ee0-ac86-52b2dc900289. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] Acquiring lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] Acquired lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG nova.network.neutron [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Refreshing network info cache for port e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfKIBrSO {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfKIBrSO" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed9847b-432f-426b-b1be-d8c5bb65c619]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfKIBrSO'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[80924ff1-7239-4784-9e82-fdeb08e40957]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b665f29-9451-4211-9f14-1fa4e15f62bb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed60d26-0f90-4a67-9324-c12f5ef51144]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]
Oct 23 15:28:03 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.
Oct 23 15:28:03 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[745ba83f-ca03-4152-859d-eab5630ebf2f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[35951abc-50b2-43b3-8c8c-d33d8fe4092f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:03 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa7b7f4-cef8-45ec-a325-2c3e43b1421f]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Creating tmpfile /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/tmpjyz85y2r to verify with other compute node that the instance is on the same shared storage. {{(pid=74421) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updated VIF entry in instance network info cache for port e31e3015-9410-4ee0-ac86-52b2dc900289. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updating instance_info_cache with network_info: [{"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-29bfab84-6b0a-4d32-8fd5-d2d9ad5f39aa req-c8fc62da-a855-43d5-8689-f522704ecb0b service nova] Releasing lock "refresh_cache-8d6ead20-f082-416a-a1f4-7e680e3ad9b7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-f4abb482-bbe5-41c6-a47f-9cdfcdef538c req-14f7da92-aa41-4cda-98de-6f0c811ea086 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f4abb482-bbe5-41c6-a47f-9cdfcdef538c req-14f7da92-aa41-4cda-98de-6f0c811ea086 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f4abb482-bbe5-41c6-a47f-9cdfcdef538c req-14f7da92-aa41-4cda-98de-6f0c811ea086 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f4abb482-bbe5-41c6-a47f-9cdfcdef538c req-14f7da92-aa41-4cda-98de-6f0c811ea086 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-f4abb482-bbe5-41c6-a47f-9cdfcdef538c req-14f7da92-aa41-4cda-98de-6f0c811ea086 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:03 user nova-compute[74421]: WARNING nova.compute.manager [req-f4abb482-bbe5-41c6-a47f-9cdfcdef538c req-14f7da92-aa41-4cda-98de-6f0c811ea086 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state resized and task_state resize_reverting.
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26334313631643235', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334313631643235', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'flavor' on Instance uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance destroyed successfully.
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.objects.instance [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'resources' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:26:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:26:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dd217a3-a5, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7c3353e-14bb-466d-9835-f8342f3e1e56) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:28:04 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:28:04 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:28:04 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:28:04 user nova-compute[74421]:   <serial>60bbdf62-e2ca-4d93-98f0-71b544193882</serial>
Oct 23 15:28:04 user nova-compute[74421]: </disk>
Oct 23 15:28:04 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:04 user nova-compute[74421]: INFO os_vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5')
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:04 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979efd0-44a6-4ece-aa7a-d86c1ade1e5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:28:04 user nova-compute[74421]: No targets found.
Oct 23 15:28:04 user nova-compute[74421]: iSNS:
Oct 23 15:28:04 user nova-compute[74421]: No targets found.
Oct 23 15:28:04 user nova-compute[74421]: STATIC:
Oct 23 15:28:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:28:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:28:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:28:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:28:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:28:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:28:04 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:28:04 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:28:04 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:28:04 user nova-compute[74421]: FIRMWARE:
Oct 23 15:28:04 user nova-compute[74421]: No targets found.
Oct 23 15:28:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:28:04 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:28:04 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacbe5a1-9fc0-4f5a-b568-4c97a38f47aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[533692b5-60c3-435d-b770-6ef3363006f8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:04 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:04 user nova-compute[74421]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:04 user nova-compute[74421]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:04 user nova-compute[74421]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478207250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9'): ({'sdh'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Removing single pathed devices sdh {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50c4121-1bcf-455b-b993-4f70d6876e33]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[771bfec0-ef71-417c-8a33-38b02aa65bc6]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flushing IO for device /dev/sdh {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b1a79-556f-455f-9c64-b5c415e12f22]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa1fcc6-8c92-453c-b79c-704bf8525ed6]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f13e3-8c2b-47f4-a4f7-6dc26fa0c203]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7dddc6-e86f-49e4-af05-c85ebc9b76db]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]
Oct 23 15:28:04 user nova-compute[74421]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.
Oct 23 15:28:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa025d4-d5e1-491f-9d7c-ba12428d2ef4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== disconnect_volume: return (363ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No VIF found with MAC fa:16:3e:10:bf:ea, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:28:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8569d0d3-703e-4a04-89e9-976f564995c5 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.143s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG nova.objects.instance [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'migration_context' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG nova.objects.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Object Instance<ee5687a0-6e1a-4ce6-954a-d6959b2c8c12> lazy-loaded attributes: resources,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-1e79003c-c82c-4db5-89d9-fe599763e1f8 req-24ab0dbd-a8bb-4217-9b18-822bcd76deef service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1e79003c-c82c-4db5-89d9-fe599763e1f8 req-24ab0dbd-a8bb-4217-9b18-822bcd76deef service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1e79003c-c82c-4db5-89d9-fe599763e1f8 req-24ab0dbd-a8bb-4217-9b18-822bcd76deef service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1e79003c-c82c-4db5-89d9-fe599763e1f8 req-24ab0dbd-a8bb-4217-9b18-822bcd76deef service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-1e79003c-c82c-4db5-89d9-fe599763e1f8 req-24ab0dbd-a8bb-4217-9b18-822bcd76deef service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:05 user nova-compute[74421]: WARNING nova.compute.manager [req-1e79003c-c82c-4db5-89d9-fe599763e1f8 req-24ab0dbd-a8bb-4217-9b18-822bcd76deef service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state resized and task_state resize_reverting.
Oct 23 15:28:06 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:28:06 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:28:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.448s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:06 user nova-compute[74421]: INFO nova.compute.manager [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Swapping old allocation on dict_keys(['a41abbd0-486b-47b6-812b-369e07ceaa0f']) held by migration d1dedd3d-61c0-4787-932d-88963e592c50 for instance
Oct 23 15:28:06 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Overwriting current allocation {'allocations': {'a41abbd0-486b-47b6-812b-369e07ceaa0f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '6fd7efc2de094cc6b45ebe7e14aceecb', 'user_id': 'ce501ef5d45c43efa6fd1329bd1b417d', 'consumer_generation': 1} on consumer ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 23 15:28:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquired lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:06 user nova-compute[74421]: INFO nova.compute.manager [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Rebuilding instance
Oct 23 15:28:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-e25a03ce-0fa2-41c7-bcc1-326d1c80e662 req-7d7a2d3e-04d4-4830-90a0-eb05fb5033b0 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-unplugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e25a03ce-0fa2-41c7-bcc1-326d1c80e662 req-7d7a2d3e-04d4-4830-90a0-eb05fb5033b0 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e25a03ce-0fa2-41c7-bcc1-326d1c80e662 req-7d7a2d3e-04d4-4830-90a0-eb05fb5033b0 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e25a03ce-0fa2-41c7-bcc1-326d1c80e662 req-7d7a2d3e-04d4-4830-90a0-eb05fb5033b0 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-e25a03ce-0fa2-41c7-bcc1-326d1c80e662 req-7d7a2d3e-04d4-4830-90a0-eb05fb5033b0 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-unplugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:07 user nova-compute[74421]: WARNING nova.compute.manager [req-e25a03ce-0fa2-41c7-bcc1-326d1c80e662 req-7d7a2d3e-04d4-4830-90a0-eb05fb5033b0 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-unplugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state active and task_state rebuilding.
Oct 23 15:28:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG nova.network.neutron [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Releasing lock "refresh_cache-ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG os_brick.utils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[261dd3a7-b529-4588-9a31-00242d94259e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f02acf1-950f-4949-9c02-dfc29da41c27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a2f9a2-f989-453e-9ccf-3a37f6ff56bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4471959-64fd-47da-8158-30baa9f01a3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:07 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:28:07 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed8ea6-223e-4537-ad28-e452d6c5dc55]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:28:07 user nova-compute[74421]: DEBUG os_brick.utils [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:07 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance destroyed successfully.
Oct 23 15:28:07 user nova-compute[74421]: INFO nova.compute.manager [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Detaching volume 60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:28:08 user nova-compute[74421]: INFO nova.virt.block_device [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attempting to driver detach volume 60bbdf62-e2ca-4d93-98f0-71b544193882 from mountpoint /dev/vdb
Oct 23 15:28:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Attempting to detach device vdb from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:28:08 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:28:08 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:28:08 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:28:08 user nova-compute[74421]:   <serial>60bbdf62-e2ca-4d93-98f0-71b544193882</serial>
Oct 23 15:28:08 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:28:08 user nova-compute[74421]: </disk>
Oct 23 15:28:08 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:28:08 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully detached device vdb from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 from the persistent domain config.
Oct 23 15:28:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:08 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc31f045-9bff-4cfb-a48a-0e1b1bb071ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:28:08 user nova-compute[74421]: No targets found.
Oct 23 15:28:08 user nova-compute[74421]: iSNS:
Oct 23 15:28:08 user nova-compute[74421]: No targets found.
Oct 23 15:28:08 user nova-compute[74421]: STATIC:
Oct 23 15:28:08 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:28:08 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:28:08 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:28:08 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:28:08 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:28:08 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:28:08 user nova-compute[74421]: FIRMWARE:
Oct 23 15:28:08 user nova-compute[74421]: No targets found.
Oct 23 15:28:08 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:28:08 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:28:08 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[843f3840-b205-4b5f-87b9-fba69e4c5364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0899b6db-60e2-4cf4-9dae-fa85f99b2e48]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:08 user nova-compute[74421]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:08 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:08 user nova-compute[74421]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:08 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782a7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35598dd-bef0-4b19-809b-b08472def1cb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861e4cf-968e-4d4d-899c-2b8b11484d0c]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b8088-0f40-4420-81cb-7590d0993511]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbbe26e-6fa0-4a28-8ceb-937efca7f366]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc98cb47-9c91-4c24-a24e-fde2a6e4a3cc]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[057bd95b-23cd-4207-8621-6cb1fe6c8b7a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]
Oct 23 15:28:08 user nova-compute[74421]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.
Oct 23 15:28:08 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c393eee-f33b-47fd-b057-480191de82c5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== disconnect_volume: return (324ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:28:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance destroyed successfully.
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-506788264',display_name='tempest-ServerActionsTestOtherA-server-1104309008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-506788264',id=15,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmW0O5aoiaZpMBDkAmf3an82vwxyINqA/CDwM1m4iutk0cJWpJOWhGgGr5W1axIpB/Fe6m00qmB62wc7PmAYE80M80+8qw8gMXJmRIeUGjn5QOJH0K4N/UF1rhqizfqmg==',key_name='tempest-keypair-1144591236',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-y0tfs0mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=0879f788-a600-4bfe-b858-deec2a8b1a51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05470b57-ee, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1b9c179-c642-438f-aaca-b10a71df9fac) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-1fd200d5-dce6-4227-90eb-51ed88415225 req-f98ac616-d02d-4eea-b211-e8dd55c53af7 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1fd200d5-dce6-4227-90eb-51ed88415225 req-f98ac616-d02d-4eea-b211-e8dd55c53af7 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1fd200d5-dce6-4227-90eb-51ed88415225 req-f98ac616-d02d-4eea-b211-e8dd55c53af7 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1fd200d5-dce6-4227-90eb-51ed88415225 req-f98ac616-d02d-4eea-b211-e8dd55c53af7 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-1fd200d5-dce6-4227-90eb-51ed88415225 req-f98ac616-d02d-4eea-b211-e8dd55c53af7 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:09 user nova-compute[74421]: WARNING nova.compute.manager [req-1fd200d5-dce6-4227-90eb-51ed88415225 req-f98ac616-d02d-4eea-b211-e8dd55c53af7 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state active and task_state rebuilding.
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:09 user nova-compute[74421]: INFO os_vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee')
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:09 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f73af13-ae5c-403b-abf7-3b777415a6a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:28:09 user nova-compute[74421]: No targets found.
Oct 23 15:28:09 user nova-compute[74421]: iSNS:
Oct 23 15:28:09 user nova-compute[74421]: No targets found.
Oct 23 15:28:09 user nova-compute[74421]: STATIC:
Oct 23 15:28:09 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:28:09 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:28:09 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:28:09 user nova-compute[74421]: FIRMWARE:
Oct 23 15:28:09 user nova-compute[74421]: No targets found.
Oct 23 15:28:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:28:09 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:28:09 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[79521143-44f3-4865-93b8-4bd74431c259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d3a2a-b8d1-4085-ae9f-608fb8875c56]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:09 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782a7760>, {}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Disconnecting from: [] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== disconnect_volume: return (83ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:28:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Deleting instance files /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51_del
Oct 23 15:28:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Deletion of /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51_del complete
Oct 23 15:28:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:09 user nova-compute[74421]: INFO nova.virt.block_device [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Booting with volume 60bbdf62-e2ca-4d93-98f0-71b544193882 at /dev/vdb
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.utils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8fe2b0-f81d-4869-b28b-98de8639579a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720aca6-1abb-417a-b195-87d5dc9bdc27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d3172-1b8b-4f8a-957d-928d01873685]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbdf4c3-4cc7-4dc6-827f-5eae0b910ced]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:09 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:28:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296626f-f126-44d4-9f27-d00251aaf7f6]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG os_brick.utils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:09 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updating existing volume attachment record: 130baa5b-1d1a-42d3-bf21-e7f81c8e4bf2 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:11 user nova-compute[74421]: WARNING nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] While synchronizing instance power states, found 9 instances in the database and 7 instances on the hypervisor.
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 110e0389-5c67-43c8-adff-dc9af9eff34e {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 797f85e1-87ce-4295-8e14-19fd0919f2a0 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 83da5c9e-eac9-4f74-9c0c-b003b475415a {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: INFO nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: INFO nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lazy-loading 'flavor' on Instance uuid 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:18 user nova-compute[74421]: INFO nova.compute.manager [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Attaching volume d2623429-6306-4df0-bbca-8d83ba2c20b4 to /dev/vdb
Oct 23 15:28:18 user nova-compute[74421]: DEBUG os_brick.utils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[394509c5-ec36-455e-ac5d-f6be9a77f30b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbffa7-af6b-4caa-a21c-b5b456920bfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eebaa5e-4c28-4b09-a797-13cf1da237b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841bb6b-e5a1-4e27-9809-4935e2aa8df6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:18 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:28:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[766e136f-bb96-46d8-af6d-8dbf6fa6a3d7]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG os_brick.utils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:18 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updating existing volume attachment record: 99d9bd68-9b50-4e57-99c6-da6982c780f3 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:28:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Starting finish_revert_migration {{(pid=74421) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start _get_guest_xml network_info=[{"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '4d24e7ec-faf1-4228-9d83-325b2ebadd26', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee5687a0-6e1a-4ce6-954a-d6959b2c8c12', 'attached_at': '2023-10-23T15:28:26.000000', 'detached_at': '', 'volume_id': '1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'serial': '1b86caa5-8282-4d91-8d51-b75cdd1bc9a9'}, 'boot_index': None, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:28:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:25 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:25 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:25 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87dcb5-8dc9-46dd-a315-20c4d02e657b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:28:25 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[31451bef-04e7-4409-801b-95187a565439]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9] added
Oct 23 15:28:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7cb766-ad66-4f22-92ca-35f0c28c0951]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[911011a5-f3e7-4a44-888b-94c9bb70b462]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYJqGDtx {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYJqGDtx" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7dff0-183d-4e53-b2a0-d184e8151664]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYJqGDtx'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd95e1c-7504-4539-a37c-0f898d60ae00]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e294a-592d-4b90-a80d-2e5fcbf131cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46a4bc-bbc7-446b-8e73-88406d296b57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]
Oct 23 15:28:26 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.
Oct 23 15:28:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5466f-8c3a-4ded-a109-584e5f37d7ac]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a1eaa-835d-4365-9f5a-cf43312e50a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:26 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:26 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9148f-dc51-429f-a76a-f9bc68927626]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:28:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26631343332616537', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343332616537', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:26:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:28:27 user nova-compute[74421]:   <uuid>ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</uuid>
Oct 23 15:28:27 user nova-compute[74421]:   <name>instance-00000006</name>
Oct 23 15:28:27 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:28:27 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:28:27 user nova-compute[74421]:   <metadata>
Oct 23 15:28:27 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:28:27 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:28:27 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherB-server-652792039</nova:name>
Oct 23 15:28:27 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:28:25</nova:creationTime>
Oct 23 15:28:27 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:28:27 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:28:27 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:28:27 user nova-compute[74421]:       <nova:owner>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:user uuid="ce501ef5d45c43efa6fd1329bd1b417d">tempest-ServerActionsTestOtherB-919492088-project-member</nova:user>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:project uuid="6fd7efc2de094cc6b45ebe7e14aceecb">tempest-ServerActionsTestOtherB-919492088</nova:project>
Oct 23 15:28:27 user nova-compute[74421]:       </nova:owner>
Oct 23 15:28:27 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:28:27 user nova-compute[74421]:       <nova:ports>
Oct 23 15:28:27 user nova-compute[74421]:         <nova:port uuid="7dd217a3-a501-4e28-a7f6-659356f41eca">
Oct 23 15:28:27 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:28:27 user nova-compute[74421]:         </nova:port>
Oct 23 15:28:27 user nova-compute[74421]:       </nova:ports>
Oct 23 15:28:27 user nova-compute[74421]:     </nova:instance>
Oct 23 15:28:27 user nova-compute[74421]:   </metadata>
Oct 23 15:28:27 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:28:27 user nova-compute[74421]:     <system>
Oct 23 15:28:27 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:28:27 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:28:27 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:28:27 user nova-compute[74421]:       <entry name="serial">ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</entry>
Oct 23 15:28:27 user nova-compute[74421]:       <entry name="uuid">ee5687a0-6e1a-4ce6-954a-d6959b2c8c12</entry>
Oct 23 15:28:27 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:28:27 user nova-compute[74421]:     </system>
Oct 23 15:28:27 user nova-compute[74421]:   </sysinfo>
Oct 23 15:28:27 user nova-compute[74421]:   <os>
Oct 23 15:28:27 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:28:27 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:28:27 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:28:27 user nova-compute[74421]:   </os>
Oct 23 15:28:27 user nova-compute[74421]:   <features>
Oct 23 15:28:27 user nova-compute[74421]:     <acpi/>
Oct 23 15:28:27 user nova-compute[74421]:     <apic/>
Oct 23 15:28:27 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:28:27 user nova-compute[74421]:   </features>
Oct 23 15:28:27 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:28:27 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:28:27 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:28:27 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:28:27 user nova-compute[74421]:   </clock>
Oct 23 15:28:27 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:28:27 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:28:27 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:28:27 user nova-compute[74421]:   </cpu>
Oct 23 15:28:27 user nova-compute[74421]:   <devices>
Oct 23 15:28:27 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:28:27 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:28:27 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk"/>
Oct 23 15:28:27 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:28:27 user nova-compute[74421]:     </disk>
Oct 23 15:28:27 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:28:27 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:28:27 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:28:27 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:28:27 user nova-compute[74421]:       <serial>1b86caa5-8282-4d91-8d51-b75cdd1bc9a9</serial>
Oct 23 15:28:27 user nova-compute[74421]:     </disk>
Oct 23 15:28:27 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:28:27 user nova-compute[74421]:       <mac address="fa:16:3e:c9:79:7e"/>
Oct 23 15:28:27 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:27 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:28:27 user nova-compute[74421]:       <target dev="tap7dd217a3-a5"/>
Oct 23 15:28:27 user nova-compute[74421]:     </interface>
Oct 23 15:28:27 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:28:27 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/console.log" append="off"/>
Oct 23 15:28:27 user nova-compute[74421]:     </serial>
Oct 23 15:28:27 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:28:27 user nova-compute[74421]:     <video>
Oct 23 15:28:27 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:27 user nova-compute[74421]:     </video>
Oct 23 15:28:27 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:28:27 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:28:27 user nova-compute[74421]:     </rng>
Oct 23 15:28:27 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:28:27 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:28:27 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:28:27 user nova-compute[74421]:     </memballoon>
Oct 23 15:28:27 user nova-compute[74421]:   </devices>
Oct 23 15:28:27 user nova-compute[74421]: </domain>
Oct 23 15:28:27 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:26:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG os_vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74c9b4e8-b78a-5087-967b-49bf23df1c4c', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dd217a3-a5, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dd217a3-a5, col_values=(('qos', UUID('71dd2994-2bb1-40f8-b834-1a2c9b0b84a9')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dd217a3-a5, col_values=(('external_ids', {'iface-id': '7dd217a3-a501-4e28-a7f6-659356f41eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:79:7e', 'vm-uuid': 'ee5687a0-6e1a-4ce6-954a-d6959b2c8c12'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:27 user nova-compute[74421]: INFO os_vif [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5')
Oct 23 15:28:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "dcb2df43-8338-412d-b3f6-e506fea10603" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:27 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:28:27 user nova-compute[74421]: INFO nova.compute.claims [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Claim successful on node user
Oct 23 15:28:28 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG nova.network.neutron [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:28:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Creating image(s)
Oct 23 15:28:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-abb69d38-3023-4de2-a966-1af71c08bf47 req-6bc422db-d4d5-4f7b-9a57-608f068bba26 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-abb69d38-3023-4de2-a966-1af71c08bf47 req-6bc422db-d4d5-4f7b-9a57-608f068bba26 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-abb69d38-3023-4de2-a966-1af71c08bf47 req-6bc422db-d4d5-4f7b-9a57-608f068bba26 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-abb69d38-3023-4de2-a966-1af71c08bf47 req-6bc422db-d4d5-4f7b-9a57-608f068bba26 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-abb69d38-3023-4de2-a966-1af71c08bf47 req-6bc422db-d4d5-4f7b-9a57-608f068bba26 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:29 user nova-compute[74421]: WARNING nova.compute.manager [req-abb69d38-3023-4de2-a966-1af71c08bf47 req-6bc422db-d4d5-4f7b-9a57-608f068bba26 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state resized and task_state resize_reverting.
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.policy [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '912eb1b1fd73437490d09a57a8d85831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cfc1ff1ed441fe993ff3f5cf7606b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:28:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Creating image(s)
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "/opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "/opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk 1073741824" returned: 0 in 0.057s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.261s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:29 user nova-compute[74421]: INFO nova.compute.manager [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Unrescuing
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.270s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.251s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk 1073741824" returned: 0 in 0.066s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Cannot resize image /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Ensure instance console log exists: /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Start _get_guest_xml network_info=[{"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '130baa5b-1d1a-42d3-bf21-e7f81c8e4bf2', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0879f788-a600-4bfe-b858-deec2a8b1a51', 'attached_at': '', 'detached_at': '', 'volume_id': '60bbdf62-e2ca-4d93-98f0-71b544193882', 'serial': '60bbdf62-e2ca-4d93-98f0-71b544193882'}, 'boot_index': None, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:28:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 15:28:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Successfully created port: 836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:28:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:30 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:30 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:30 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.259s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f573eb7-133d-45e3-8109-361d47953163]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:28:30 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[36568bce-82bc-426e-b5bb-de3f70fdd4ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882] added
Oct 23 15:28:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5672b7b9-1038-4e83-97c9-3c8e3859e03f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c77964f-0218-4e94-8cda-35f2f153500e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfKIBrSO {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfKIBrSO" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa16d853-6ea1-47c1-9361-4d86905ca48d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfKIBrSO'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[127df743-6ee4-46b3-89fe-d79cbfc28a6c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Cannot resize image /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Ensure instance console log exists: /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049f5e0-3049-41a2-9bc6-8ce2e5071c1f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.objects.instance [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'flavor' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[549a789d-b8a7-412f-896c-8eca44a84d71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]
Oct 23 15:28:30 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.
Oct 23 15:28:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46a0388-a81d-454a-9e32-c910794e7a16]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbc8fc8-bdb7-4ef3-9028-09b8071a3943]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66afdc-8aef-427e-8a5a-12ddd80a1336]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Successfully updated port: 836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "refresh_cache-dcb2df43-8338-412d-b3f6-e506fea10603" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquired lock "refresh_cache-dcb2df43-8338-412d-b3f6-e506fea10603" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-53ea9b1a-c2d0-4d1e-8a79-48d50af54855 req-597538db-7918-44e5-9dc1-d3e1fdea2f49 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-53ea9b1a-c2d0-4d1e-8a79-48d50af54855 req-597538db-7918-44e5-9dc1-d3e1fdea2f49 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-53ea9b1a-c2d0-4d1e-8a79-48d50af54855 req-597538db-7918-44e5-9dc1-d3e1fdea2f49 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-53ea9b1a-c2d0-4d1e-8a79-48d50af54855 req-597538db-7918-44e5-9dc1-d3e1fdea2f49 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-53ea9b1a-c2d0-4d1e-8a79-48d50af54855 req-597538db-7918-44e5-9dc1-d3e1fdea2f49 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:30 user nova-compute[74421]: WARNING nova.compute.manager [req-53ea9b1a-c2d0-4d1e-8a79-48d50af54855 req-597538db-7918-44e5-9dc1-d3e1fdea2f49 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:28:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-20ddc851-4456-418c-9f36-63084a55c0d4 req-96437be7-014f-41f4-813d-e518f8c4e74a service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-20ddc851-4456-418c-9f36-63084a55c0d4 req-96437be7-014f-41f4-813d-e518f8c4e74a service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-20ddc851-4456-418c-9f36-63084a55c0d4 req-96437be7-014f-41f4-813d-e518f8c4e74a service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-20ddc851-4456-418c-9f36-63084a55c0d4 req-96437be7-014f-41f4-813d-e518f8c4e74a service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-20ddc851-4456-418c-9f36-63084a55c0d4 req-96437be7-014f-41f4-813d-e518f8c4e74a service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:31 user nova-compute[74421]: WARNING nova.compute.manager [req-20ddc851-4456-418c-9f36-63084a55c0d4 req-96437be7-014f-41f4-813d-e518f8c4e74a service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state resized and task_state resize_reverting.
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance destroyed successfully.
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Updating instance_info_cache with network_info: [{"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Releasing lock "refresh_cache-dcb2df43-8338-412d-b3f6-e506fea10603" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Instance network_info: |[{"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Start _get_guest_xml network_info=[{"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:28:31 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance running successfully.
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] finish_revert_migration finished successfully. {{(pid=74421) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 23 15:28:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-243071967',display_name='tempest-VolumesActionsTest-instance-243071967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-243071967',id=19,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cfc1ff1ed441fe993ff3f5cf7606b1',ramdisk_id='',reservation_id='r-o5t63j10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-393084464',owner_user_name='tempest-VolumesActionsTest-393084464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:29Z,user_data=None,user_id='912eb1b1fd73437490d09a57a8d85831',uuid=dcb2df43-8338-412d-b3f6-e506fea10603,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converting VIF {"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.objects.instance [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lazy-loading 'pci_devices' on Instance uuid dcb2df43-8338-412d-b3f6-e506fea10603 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:28:31 user nova-compute[74421]:   <uuid>dcb2df43-8338-412d-b3f6-e506fea10603</uuid>
Oct 23 15:28:31 user nova-compute[74421]:   <name>instance-00000013</name>
Oct 23 15:28:31 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:28:31 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:28:31 user nova-compute[74421]:   <metadata>
Oct 23 15:28:31 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:28:31 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:name>tempest-VolumesActionsTest-instance-243071967</nova:name>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:28:31</nova:creationTime>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:28:31 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:28:31 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:owner>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:user uuid="912eb1b1fd73437490d09a57a8d85831">tempest-VolumesActionsTest-393084464-project-member</nova:user>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:project uuid="a0cfc1ff1ed441fe993ff3f5cf7606b1">tempest-VolumesActionsTest-393084464</nova:project>
Oct 23 15:28:31 user nova-compute[74421]:       </nova:owner>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:ports>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:port uuid="836eab32-4ed0-4fa3-bd1d-8f413a07eb56">
Oct 23 15:28:31 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:28:31 user nova-compute[74421]:         </nova:port>
Oct 23 15:28:31 user nova-compute[74421]:       </nova:ports>
Oct 23 15:28:31 user nova-compute[74421]:     </nova:instance>
Oct 23 15:28:31 user nova-compute[74421]:   </metadata>
Oct 23 15:28:31 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:28:31 user nova-compute[74421]:     <system>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="serial">dcb2df43-8338-412d-b3f6-e506fea10603</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="uuid">dcb2df43-8338-412d-b3f6-e506fea10603</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:28:31 user nova-compute[74421]:     </system>
Oct 23 15:28:31 user nova-compute[74421]:   </sysinfo>
Oct 23 15:28:31 user nova-compute[74421]:   <os>
Oct 23 15:28:31 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:28:31 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:28:31 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:28:31 user nova-compute[74421]:   </os>
Oct 23 15:28:31 user nova-compute[74421]:   <features>
Oct 23 15:28:31 user nova-compute[74421]:     <acpi/>
Oct 23 15:28:31 user nova-compute[74421]:     <apic/>
Oct 23 15:28:31 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:28:31 user nova-compute[74421]:   </features>
Oct 23 15:28:31 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:28:31 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:28:31 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:28:31 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:28:31 user nova-compute[74421]:   </clock>
Oct 23 15:28:31 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:28:31 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:28:31 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:28:31 user nova-compute[74421]:   </cpu>
Oct 23 15:28:31 user nova-compute[74421]:   <devices>
Oct 23 15:28:31 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:28:31 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:28:31 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk"/>
Oct 23 15:28:31 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:     </disk>
Oct 23 15:28:31 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:28:31 user nova-compute[74421]:       <mac address="fa:16:3e:66:65:37"/>
Oct 23 15:28:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:28:31 user nova-compute[74421]:       <target dev="tap836eab32-4e"/>
Oct 23 15:28:31 user nova-compute[74421]:     </interface>
Oct 23 15:28:31 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:28:31 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/console.log" append="off"/>
Oct 23 15:28:31 user nova-compute[74421]:     </serial>
Oct 23 15:28:31 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:28:31 user nova-compute[74421]:     <video>
Oct 23 15:28:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:     </video>
Oct 23 15:28:31 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:28:31 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:28:31 user nova-compute[74421]:     </rng>
Oct 23 15:28:31 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:28:31 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:28:31 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:28:31 user nova-compute[74421]:     </memballoon>
Oct 23 15:28:31 user nova-compute[74421]:   </devices>
Oct 23 15:28:31 user nova-compute[74421]: </domain>
Oct 23 15:28:31 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-243071967',display_name='tempest-VolumesActionsTest-instance-243071967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-243071967',id=19,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cfc1ff1ed441fe993ff3f5cf7606b1',ramdisk_id='',reservation_id='r-o5t63j10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-393084464',owner_user_name='tempest-VolumesActionsTest-393084464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:29Z,user_data=None,user_id='912eb1b1fd73437490d09a57a8d85831',uuid=dcb2df43-8338-412d-b3f6-e506fea10603,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converting VIF {"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG os_vif [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '234043b2-6212-5fe7-a5b1-536b72a76913', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap836eab32-4e, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap836eab32-4e, col_values=(('qos', UUID('5ca54d18-37a8-4a6a-b3d9-8256350f5ee4')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap836eab32-4e, col_values=(('external_ids', {'iface-id': '836eab32-4ed0-4fa3-bd1d-8f413a07eb56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:65:37', 'vm-uuid': 'dcb2df43-8338-412d-b3f6-e506fea10603'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: INFO os_vif [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e')
Oct 23 15:28:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26334313631643235', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334313631643235', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-506788264',display_name='tempest-ServerActionsTestOtherA-server-1104309008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-506788264',id=15,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmW0O5aoiaZpMBDkAmf3an82vwxyINqA/CDwM1m4iutk0cJWpJOWhGgGr5W1axIpB/Fe6m00qmB62wc7PmAYE80M80+8qw8gMXJmRIeUGjn5QOJH0K4N/UF1rhqizfqmg==',key_name='tempest-keypair-1144591236',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-y0tfs0mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=0879f788-a600-4bfe-b858-deec2a8b1a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:28:31 user nova-compute[74421]:   <uuid>0879f788-a600-4bfe-b858-deec2a8b1a51</uuid>
Oct 23 15:28:31 user nova-compute[74421]:   <name>instance-0000000f</name>
Oct 23 15:28:31 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:28:31 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:28:31 user nova-compute[74421]:   <metadata>
Oct 23 15:28:31 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:28:31 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherA-server-1104309008</nova:name>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:28:29</nova:creationTime>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:28:31 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:28:31 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:owner>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:user uuid="182146bec4cf473ab9e025bca5a74371">tempest-ServerActionsTestOtherA-369604222-project-member</nova:user>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:project uuid="d0053dc54a1e44f18966d687a2bb42e4">tempest-ServerActionsTestOtherA-369604222</nova:project>
Oct 23 15:28:31 user nova-compute[74421]:       </nova:owner>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:28:31 user nova-compute[74421]:       <nova:ports>
Oct 23 15:28:31 user nova-compute[74421]:         <nova:port uuid="05470b57-eedc-49e7-b83d-6ae2db174534">
Oct 23 15:28:31 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:28:31 user nova-compute[74421]:         </nova:port>
Oct 23 15:28:31 user nova-compute[74421]:       </nova:ports>
Oct 23 15:28:31 user nova-compute[74421]:     </nova:instance>
Oct 23 15:28:31 user nova-compute[74421]:   </metadata>
Oct 23 15:28:31 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:28:31 user nova-compute[74421]:     <system>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="serial">0879f788-a600-4bfe-b858-deec2a8b1a51</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="uuid">0879f788-a600-4bfe-b858-deec2a8b1a51</entry>
Oct 23 15:28:31 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:28:31 user nova-compute[74421]:     </system>
Oct 23 15:28:31 user nova-compute[74421]:   </sysinfo>
Oct 23 15:28:31 user nova-compute[74421]:   <os>
Oct 23 15:28:31 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:28:31 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:28:31 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:28:31 user nova-compute[74421]:   </os>
Oct 23 15:28:31 user nova-compute[74421]:   <features>
Oct 23 15:28:31 user nova-compute[74421]:     <acpi/>
Oct 23 15:28:31 user nova-compute[74421]:     <apic/>
Oct 23 15:28:31 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:28:31 user nova-compute[74421]:   </features>
Oct 23 15:28:31 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:28:31 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:28:31 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:28:31 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:28:31 user nova-compute[74421]:   </clock>
Oct 23 15:28:31 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:28:31 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:28:31 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:28:31 user nova-compute[74421]:   </cpu>
Oct 23 15:28:31 user nova-compute[74421]:   <devices>
Oct 23 15:28:31 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:28:31 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:28:31 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk"/>
Oct 23 15:28:31 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:     </disk>
Oct 23 15:28:31 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:28:31 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:28:31 user nova-compute[74421]:       <source dev="/dev/sdc"/>
Oct 23 15:28:31 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:       <serial>60bbdf62-e2ca-4d93-98f0-71b544193882</serial>
Oct 23 15:28:31 user nova-compute[74421]:     </disk>
Oct 23 15:28:31 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:28:31 user nova-compute[74421]:       <mac address="fa:16:3e:10:bf:ea"/>
Oct 23 15:28:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:28:31 user nova-compute[74421]:       <target dev="tap05470b57-ee"/>
Oct 23 15:28:31 user nova-compute[74421]:     </interface>
Oct 23 15:28:31 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:28:31 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/console.log" append="off"/>
Oct 23 15:28:31 user nova-compute[74421]:     </serial>
Oct 23 15:28:31 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:28:31 user nova-compute[74421]:     <video>
Oct 23 15:28:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:31 user nova-compute[74421]:     </video>
Oct 23 15:28:31 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:28:31 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:28:31 user nova-compute[74421]:     </rng>
Oct 23 15:28:31 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:28:31 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:28:31 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:28:31 user nova-compute[74421]:     </memballoon>
Oct 23 15:28:31 user nova-compute[74421]:   </devices>
Oct 23 15:28:31 user nova-compute[74421]: </domain>
Oct 23 15:28:31 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-506788264',display_name='tempest-ServerActionsTestOtherA-server-1104309008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-506788264',id=15,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmW0O5aoiaZpMBDkAmf3an82vwxyINqA/CDwM1m4iutk0cJWpJOWhGgGr5W1axIpB/Fe6m00qmB62wc7PmAYE80M80+8qw8gMXJmRIeUGjn5QOJH0K4N/UF1rhqizfqmg==',key_name='tempest-keypair-1144591236',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-y0tfs0mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=0879f788-a600-4bfe-b858-deec2a8b1a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG os_vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f86e9048-b621-5f41-9b94-c584e4fb6faf', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] No VIF found with MAC fa:16:3e:66:65:37, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: INFO nova.compute.manager [None req-02f4144e-b995-405f-a943-5c031ed5467d tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance to original state: 'active'
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05470b57-ee, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05470b57-ee, col_values=(('qos', UUID('23bc0688-f5ef-4f9b-9b3b-72612daee4f1')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05470b57-ee, col_values=(('external_ids', {'iface-id': '05470b57-eedc-49e7-b83d-6ae2db174534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:bf:ea', 'vm-uuid': '0879f788-a600-4bfe-b858-deec2a8b1a51'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:31 user nova-compute[74421]: INFO os_vif [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee')
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No VIF found with MAC fa:16:3e:10:bf:ea, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:28:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-changed-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Refreshing instance network info cache due to event network-changed-836eab32-4ed0-4fa3-bd1d-8f413a07eb56. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:28:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] Acquiring lock "refresh_cache-dcb2df43-8338-412d-b3f6-e506fea10603" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] Acquired lock "refresh_cache-dcb2df43-8338-412d-b3f6-e506fea10603" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Refreshing network info cache for port 836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Updated VIF entry in instance network info cache for port 836eab32-4ed0-4fa3-bd1d-8f413a07eb56. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Updating instance_info_cache with network_info: [{"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] Releasing lock "refresh_cache-dcb2df43-8338-412d-b3f6-e506fea10603" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:33 user nova-compute[74421]: WARNING nova.compute.manager [req-d740c81b-7a4e-4cc3-ba88-a32c0c5293f0 req-6eda467c-0aee-4a5a-b713-75a036272ffa service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:28:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-663639eb-24e8-49d1-9f26-94f46922249f req-48ba77eb-78ea-499d-a6ac-600a51735464 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-663639eb-24e8-49d1-9f26-94f46922249f req-48ba77eb-78ea-499d-a6ac-600a51735464 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-663639eb-24e8-49d1-9f26-94f46922249f req-48ba77eb-78ea-499d-a6ac-600a51735464 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-663639eb-24e8-49d1-9f26-94f46922249f req-48ba77eb-78ea-499d-a6ac-600a51735464 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-663639eb-24e8-49d1-9f26-94f46922249f req-48ba77eb-78ea-499d-a6ac-600a51735464 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:35 user nova-compute[74421]: WARNING nova.compute.manager [req-663639eb-24e8-49d1-9f26-94f46922249f req-48ba77eb-78ea-499d-a6ac-600a51735464 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-28d63438-70d8-4442-9ef5-1002982ba41c req-566a0a87-0301-4026-b873-8afb4b1d50d7 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-28d63438-70d8-4442-9ef5-1002982ba41c req-566a0a87-0301-4026-b873-8afb4b1d50d7 service nova] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-28d63438-70d8-4442-9ef5-1002982ba41c req-566a0a87-0301-4026-b873-8afb4b1d50d7 service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-28d63438-70d8-4442-9ef5-1002982ba41c req-566a0a87-0301-4026-b873-8afb4b1d50d7 service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-28d63438-70d8-4442-9ef5-1002982ba41c req-566a0a87-0301-4026-b873-8afb4b1d50d7 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] No waiting events found dispatching network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:35 user nova-compute[74421]: WARNING nova.compute.manager [req-28d63438-70d8-4442-9ef5-1002982ba41c req-566a0a87-0301-4026-b873-8afb4b1d50d7 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received unexpected event network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 for instance with vm_state building and task_state spawning.
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-a89f5e1a-b080-4f25-89f9-c6e1ba4ae0b1 req-d0585a23-41b6-443b-b38d-04f652e3f0bc service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a89f5e1a-b080-4f25-89f9-c6e1ba4ae0b1 req-d0585a23-41b6-443b-b38d-04f652e3f0bc service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a89f5e1a-b080-4f25-89f9-c6e1ba4ae0b1 req-d0585a23-41b6-443b-b38d-04f652e3f0bc service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a89f5e1a-b080-4f25-89f9-c6e1ba4ae0b1 req-d0585a23-41b6-443b-b38d-04f652e3f0bc service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-a89f5e1a-b080-4f25-89f9-c6e1ba4ae0b1 req-d0585a23-41b6-443b-b38d-04f652e3f0bc service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:36 user nova-compute[74421]: WARNING nova.compute.manager [req-a89f5e1a-b080-4f25-89f9-c6e1ba4ae0b1 req-d0585a23-41b6-443b-b38d-04f652e3f0bc service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state active and task_state rebuild_spawning.
Oct 23 15:28:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:28:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:28:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-438ceaac-a9f4-4104-92eb-895b65b4da99 req-cff8992e-d1ac-4f8e-933c-863d04c7422d service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-438ceaac-a9f4-4104-92eb-895b65b4da99 req-cff8992e-d1ac-4f8e-933c-863d04c7422d service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-438ceaac-a9f4-4104-92eb-895b65b4da99 req-cff8992e-d1ac-4f8e-933c-863d04c7422d service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-438ceaac-a9f4-4104-92eb-895b65b4da99 req-cff8992e-d1ac-4f8e-933c-863d04c7422d service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-438ceaac-a9f4-4104-92eb-895b65b4da99 req-cff8992e-d1ac-4f8e-933c-863d04c7422d service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:37 user nova-compute[74421]: WARNING nova.compute.manager [req-438ceaac-a9f4-4104-92eb-895b65b4da99 req-cff8992e-d1ac-4f8e-933c-863d04c7422d service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:28:37 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:37 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-d9b60ff8-3388-4334-86d1-34b3c5117d70 req-96fa623a-b802-4d22-8a76-aca10314da07 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d9b60ff8-3388-4334-86d1-34b3c5117d70 req-96fa623a-b802-4d22-8a76-aca10314da07 service nova] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d9b60ff8-3388-4334-86d1-34b3c5117d70 req-96fa623a-b802-4d22-8a76-aca10314da07 service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d9b60ff8-3388-4334-86d1-34b3c5117d70 req-96fa623a-b802-4d22-8a76-aca10314da07 service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-d9b60ff8-3388-4334-86d1-34b3c5117d70 req-96fa623a-b802-4d22-8a76-aca10314da07 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] No waiting events found dispatching network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:38 user nova-compute[74421]: WARNING nova.compute.manager [req-d9b60ff8-3388-4334-86d1-34b3c5117d70 req-96fa623a-b802-4d22-8a76-aca10314da07 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received unexpected event network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 for instance with vm_state building and task_state spawning.
Oct 23 15:28:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-6a9d319d-16a0-4281-b32d-28cc8dd8cbd5 req-708e0eec-0480-468f-abb8-d26390139a84 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a9d319d-16a0-4281-b32d-28cc8dd8cbd5 req-708e0eec-0480-468f-abb8-d26390139a84 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a9d319d-16a0-4281-b32d-28cc8dd8cbd5 req-708e0eec-0480-468f-abb8-d26390139a84 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a9d319d-16a0-4281-b32d-28cc8dd8cbd5 req-708e0eec-0480-468f-abb8-d26390139a84 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-6a9d319d-16a0-4281-b32d-28cc8dd8cbd5 req-708e0eec-0480-468f-abb8-d26390139a84 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:38 user nova-compute[74421]: WARNING nova.compute.manager [req-6a9d319d-16a0-4281-b32d-28cc8dd8cbd5 req-708e0eec-0480-468f-abb8-d26390139a84 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state active and task_state rebuild_spawning.
Oct 23 15:28:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-0d8e7597-ad5f-43cf-83a7-b5ec2adf9a11 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:28:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Instance spawned successfully.
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: INFO nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Took 10.25 seconds to spawn the instance on the hypervisor.
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:28:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance spawned successfully.
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:28:39 user nova-compute[74421]: INFO nova.compute.manager [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Took 11.65 seconds to build instance.
Oct 23 15:28:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-30e23b83-e567-496f-afb0-a68b297d9699 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "dcb2df43-8338-412d-b3f6-e506fea10603" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.904s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74421) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b8ddddb-7800-4b5e-b138-dfb1316776de tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.114s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:28:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-changed-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Refreshing instance network info cache due to event network-changed-a15077ef-9a7b-4306-b4df-5372bc63876e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] Acquiring lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] Acquired lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Refreshing network info cache for port a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:28:46 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:46 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7733MB free_disk=25.303993225097656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef24f4fa-32df-438e-bb56-ee4a0b32770c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance dcb2df43-8338-412d-b3f6-e506fea10603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:28:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG nova.network.neutron [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updated VIF entry in instance network info cache for port a15077ef-9a7b-4306-b4df-5372bc63876e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG nova.network.neutron [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updating instance_info_cache with network_info: [{"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a40ba259-0c4d-4668-b1db-152135aca4d0 req-70b8cbd0-59b0-44b2-9053-ba680c296efd service nova] Releasing lock "refresh_cache-ef24f4fa-32df-438e-bb56-ee4a0b32770c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.814s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:28:49 user nova-compute[74421]: INFO nova.compute.claims [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Claim successful on node user
Oct 23 15:28:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:28:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.network.neutron [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:28:50 user nova-compute[74421]: INFO nova.compute.claims [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Claim successful on node user
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:28:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Creating image(s)
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG nova.policy [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5629aa90fa4b40b4886cb46dc21e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ed209b95549e8a0d77ead103b1c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.221s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk 1073741824" returned: 0 in 0.081s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.901s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.259s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:28:51 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Cannot resize image /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Ensure instance console log exists: /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.policy [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5629aa90fa4b40b4886cb46dc21e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ed209b95549e8a0d77ead103b1c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:28:51 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Creating image(s)
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.281s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.319s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk 1073741824" returned: 0 in 0.064s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Successfully created port: fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Successfully created port: 0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.240s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Cannot resize image /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Ensure instance console log exists: /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.objects.instance [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'flavor' on Instance uuid ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:53 user nova-compute[74421]: INFO nova.compute.manager [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Attaching volume f7bade07-0820-48ed-94a4-6ecf302f6398 to /dev/vdb
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Successfully updated port: 0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-changed-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Refreshing instance network info cache due to event network-changed-0274fe50-08cc-4f3f-aca6-ec69220dfbfc. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] Acquiring lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG os_brick.utils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d58d7d2-e75e-47c8-aaa6-40733ae160e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[146c4047-ff19-439c-98c3-b345b3b43fd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19276a8-b436-44af-8f69-768cf3fe0033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Successfully updated port: fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcab01cb-8cf4-4672-a0ac-4f1c0bba402b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:28:53 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[25011ed9-9654-441a-8f38-b193f8284c21]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-changed-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Refreshing instance network info cache due to event network-changed-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG os_brick.utils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updating existing volume attachment record: a27f0a7f-ce25-449d-9774-003891c9b729 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance network_info: |[{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] Acquired lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Refreshing network info cache for port 0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Start _get_guest_xml network_info=[{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:28:53 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:53 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:28:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-659659007',display_name='tempest-ServerRescueNegativeTestJSON-server-659659007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-659659007',id=21,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-2s0cbhg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:51Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=19b0c20d-3f1a-4897-852a-9fb248f5d5f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.objects.instance [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'pci_devices' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:28:54 user nova-compute[74421]:   <uuid>19b0c20d-3f1a-4897-852a-9fb248f5d5f7</uuid>
Oct 23 15:28:54 user nova-compute[74421]:   <name>instance-00000015</name>
Oct 23 15:28:54 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:28:54 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:28:54 user nova-compute[74421]:   <metadata>
Oct 23 15:28:54 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:28:54 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-659659007</nova:name>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:28:53</nova:creationTime>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:28:54 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:28:54 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:owner>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:user uuid="6b5629aa90fa4b40b4886cb46dc21e65">tempest-ServerRescueNegativeTestJSON-1858635885-project-member</nova:user>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:project uuid="db8ed209b95549e8a0d77ead103b1c1a">tempest-ServerRescueNegativeTestJSON-1858635885</nova:project>
Oct 23 15:28:54 user nova-compute[74421]:       </nova:owner>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:ports>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:port uuid="0274fe50-08cc-4f3f-aca6-ec69220dfbfc">
Oct 23 15:28:54 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 15:28:54 user nova-compute[74421]:         </nova:port>
Oct 23 15:28:54 user nova-compute[74421]:       </nova:ports>
Oct 23 15:28:54 user nova-compute[74421]:     </nova:instance>
Oct 23 15:28:54 user nova-compute[74421]:   </metadata>
Oct 23 15:28:54 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:28:54 user nova-compute[74421]:     <system>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="serial">19b0c20d-3f1a-4897-852a-9fb248f5d5f7</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="uuid">19b0c20d-3f1a-4897-852a-9fb248f5d5f7</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:28:54 user nova-compute[74421]:     </system>
Oct 23 15:28:54 user nova-compute[74421]:   </sysinfo>
Oct 23 15:28:54 user nova-compute[74421]:   <os>
Oct 23 15:28:54 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:28:54 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:28:54 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:28:54 user nova-compute[74421]:   </os>
Oct 23 15:28:54 user nova-compute[74421]:   <features>
Oct 23 15:28:54 user nova-compute[74421]:     <acpi/>
Oct 23 15:28:54 user nova-compute[74421]:     <apic/>
Oct 23 15:28:54 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:28:54 user nova-compute[74421]:   </features>
Oct 23 15:28:54 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:28:54 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:28:54 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:28:54 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:28:54 user nova-compute[74421]:   </clock>
Oct 23 15:28:54 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:28:54 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:28:54 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:28:54 user nova-compute[74421]:   </cpu>
Oct 23 15:28:54 user nova-compute[74421]:   <devices>
Oct 23 15:28:54 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:28:54 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:28:54 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk"/>
Oct 23 15:28:54 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:28:54 user nova-compute[74421]:     </disk>
Oct 23 15:28:54 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:28:54 user nova-compute[74421]:       <mac address="fa:16:3e:ab:4d:45"/>
Oct 23 15:28:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:54 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:28:54 user nova-compute[74421]:       <target dev="tap0274fe50-08"/>
Oct 23 15:28:54 user nova-compute[74421]:     </interface>
Oct 23 15:28:54 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:28:54 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/console.log" append="off"/>
Oct 23 15:28:54 user nova-compute[74421]:     </serial>
Oct 23 15:28:54 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:28:54 user nova-compute[74421]:     <video>
Oct 23 15:28:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:54 user nova-compute[74421]:     </video>
Oct 23 15:28:54 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:28:54 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:28:54 user nova-compute[74421]:     </rng>
Oct 23 15:28:54 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:28:54 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:28:54 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:28:54 user nova-compute[74421]:     </memballoon>
Oct 23 15:28:54 user nova-compute[74421]:   </devices>
Oct 23 15:28:54 user nova-compute[74421]: </domain>
Oct 23 15:28:54 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-659659007',display_name='tempest-ServerRescueNegativeTestJSON-server-659659007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-659659007',id=21,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-2s0cbhg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:51Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=19b0c20d-3f1a-4897-852a-9fb248f5d5f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG os_vif [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '186a9457-f17c-5846-96c9-7eeb86e24834', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0274fe50-08, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0274fe50-08, col_values=(('qos', UUID('78146dda-7bc6-4ef3-aaa2-510d33074765')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0274fe50-08, col_values=(('external_ids', {'iface-id': '0274fe50-08cc-4f3f-aca6-ec69220dfbfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:4d:45', 'vm-uuid': '19b0c20d-3f1a-4897-852a-9fb248f5d5f7'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: INFO os_vif [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08')
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance network_info: |[{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Refreshing network info cache for port fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Start _get_guest_xml network_info=[{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:28:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:ab:4d:45, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2013166828',display_name='tempest-ServerRescueNegativeTestJSON-server-2013166828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2013166828',id=20,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-ealwh0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:50Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.objects.instance [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'pci_devices' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:28:54 user nova-compute[74421]:   <uuid>b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72</uuid>
Oct 23 15:28:54 user nova-compute[74421]:   <name>instance-00000014</name>
Oct 23 15:28:54 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:28:54 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:28:54 user nova-compute[74421]:   <metadata>
Oct 23 15:28:54 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:28:54 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2013166828</nova:name>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:28:54</nova:creationTime>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:28:54 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:28:54 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:owner>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:user uuid="6b5629aa90fa4b40b4886cb46dc21e65">tempest-ServerRescueNegativeTestJSON-1858635885-project-member</nova:user>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:project uuid="db8ed209b95549e8a0d77ead103b1c1a">tempest-ServerRescueNegativeTestJSON-1858635885</nova:project>
Oct 23 15:28:54 user nova-compute[74421]:       </nova:owner>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:28:54 user nova-compute[74421]:       <nova:ports>
Oct 23 15:28:54 user nova-compute[74421]:         <nova:port uuid="fa74a98c-d6f5-4ce5-8a5f-343dc7372e76">
Oct 23 15:28:54 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 15:28:54 user nova-compute[74421]:         </nova:port>
Oct 23 15:28:54 user nova-compute[74421]:       </nova:ports>
Oct 23 15:28:54 user nova-compute[74421]:     </nova:instance>
Oct 23 15:28:54 user nova-compute[74421]:   </metadata>
Oct 23 15:28:54 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:28:54 user nova-compute[74421]:     <system>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="serial">b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="uuid">b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72</entry>
Oct 23 15:28:54 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:28:54 user nova-compute[74421]:     </system>
Oct 23 15:28:54 user nova-compute[74421]:   </sysinfo>
Oct 23 15:28:54 user nova-compute[74421]:   <os>
Oct 23 15:28:54 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:28:54 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:28:54 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:28:54 user nova-compute[74421]:   </os>
Oct 23 15:28:54 user nova-compute[74421]:   <features>
Oct 23 15:28:54 user nova-compute[74421]:     <acpi/>
Oct 23 15:28:54 user nova-compute[74421]:     <apic/>
Oct 23 15:28:54 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:28:54 user nova-compute[74421]:   </features>
Oct 23 15:28:54 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:28:54 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:28:54 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:28:54 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:28:54 user nova-compute[74421]:   </clock>
Oct 23 15:28:54 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:28:54 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:28:54 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:28:54 user nova-compute[74421]:   </cpu>
Oct 23 15:28:54 user nova-compute[74421]:   <devices>
Oct 23 15:28:54 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:28:54 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:28:54 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk"/>
Oct 23 15:28:54 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:28:54 user nova-compute[74421]:     </disk>
Oct 23 15:28:54 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:28:54 user nova-compute[74421]:       <mac address="fa:16:3e:22:e3:17"/>
Oct 23 15:28:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:54 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:28:54 user nova-compute[74421]:       <target dev="tapfa74a98c-d6"/>
Oct 23 15:28:54 user nova-compute[74421]:     </interface>
Oct 23 15:28:54 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:28:54 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/console.log" append="off"/>
Oct 23 15:28:54 user nova-compute[74421]:     </serial>
Oct 23 15:28:54 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:28:54 user nova-compute[74421]:     <video>
Oct 23 15:28:54 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:54 user nova-compute[74421]:     </video>
Oct 23 15:28:54 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:28:54 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:28:54 user nova-compute[74421]:     </rng>
Oct 23 15:28:54 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:28:54 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:28:54 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:28:54 user nova-compute[74421]:     </memballoon>
Oct 23 15:28:54 user nova-compute[74421]:   </devices>
Oct 23 15:28:54 user nova-compute[74421]: </domain>
Oct 23 15:28:54 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2013166828',display_name='tempest-ServerRescueNegativeTestJSON-server-2013166828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2013166828',id=20,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-ealwh0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:50Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG os_vif [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01adcc5f-1aa6-5310-a231-ee0852d7ba7c', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa74a98c-d6, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa74a98c-d6, col_values=(('qos', UUID('c5bbe2c8-6268-4055-8f54-e922638650af')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa74a98c-d6, col_values=(('external_ids', {'iface-id': 'fa74a98c-d6f5-4ce5-8a5f-343dc7372e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e3:17', 'vm-uuid': 'b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: INFO os_vif [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6')
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:28:54 user nova-compute[74421]: INFO nova.compute.claims [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Claim successful on node user
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:22:e3:17, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updated VIF entry in instance network info cache for port 0274fe50-08cc-4f3f-aca6-ec69220dfbfc. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e19b5142-b6ae-444e-b21b-68349ad237ae req-cc1a5615-86d3-4e30-ba62-92e1538c930b service nova] Releasing lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updated VIF entry in instance network info cache for port fa74a98c-d6f5-4ce5-8a5f-343dc7372e76. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f195884a-052d-4fe9-ba65-a0f4fa26b9d1 req-2b7c0b95-33a1-497e-9f19-a193ef2f6ea4 service nova] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:55 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:28:55 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:28:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.456s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:28:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.policy [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e711d55fe644a0ca518fa34d187b79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e90bcb97e74feaa5e6247b7fc0d3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:28:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Creating image(s)
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "/opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk 1073741824" returned: 0 in 0.069s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.255s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Successfully created port: 4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Cannot resize image /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Ensure instance console log exists: /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-8371a26b-a1ab-4747-9649-6b8c8a504cb3 req-2371ccc7-dfdf-45d9-ac57-db41a4459234 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8371a26b-a1ab-4747-9649-6b8c8a504cb3 req-2371ccc7-dfdf-45d9-ac57-db41a4459234 service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8371a26b-a1ab-4747-9649-6b8c8a504cb3 req-2371ccc7-dfdf-45d9-ac57-db41a4459234 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8371a26b-a1ab-4747-9649-6b8c8a504cb3 req-2371ccc7-dfdf-45d9-ac57-db41a4459234 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-8371a26b-a1ab-4747-9649-6b8c8a504cb3 req-2371ccc7-dfdf-45d9-ac57-db41a4459234 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:57 user nova-compute[74421]: WARNING nova.compute.manager [req-8371a26b-a1ab-4747-9649-6b8c8a504cb3 req-2371ccc7-dfdf-45d9-ac57-db41a4459234 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state building and task_state spawning.
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDXhCmAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:28:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.073s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:28:57 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24163e6d-920c-41f2-b46f-2e76ee63deee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:28:57 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983c1d2-5576-4cca-a298-c5e81310e06a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4] added
Oct 23 15:28:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ef0fa-7b5c-460f-84e4-78bc98c9996d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[946fefd3-4b8c-4b7e-8789-53040f5b37a4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VDXhCmAt {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VDXhCmAt" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8fe796-36fd-40ab-92f5-9ef299576205]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VDXhCmAt'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a9c29f-0e4f-4eac-b88f-b2c531435f63]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc704a4-11dc-4944-8aa4-163e8bd4d730]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:57 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:57 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:57 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:57 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e10b1-93c5-4744-afe1-2c3b70409ae6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260]
Oct 23 15:28:58 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260] successful.
Oct 23 15:28:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa4c6f6-356f-4075-816c-a774297019f5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2883c170-502b-41b2-9a97-bd51fd7b56fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:28:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01851ee-38f5-477f-8c11-e4db0d1cdb71]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDXhCmAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Successfully updated port: 4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquired lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:28:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.564s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] <== connect_volume: return (1566ms) {'type': 'block', 'scsi_wwn': '26130306561656465', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130306561656465', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.objects.instance [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lazy-loading 'flavor' on Instance uuid 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:28:59 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:28:59 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:28:59 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:28:59 user nova-compute[74421]:   <serial>d2623429-6306-4df0-bbca-8d83ba2c20b4</serial>
Oct 23 15:28:59 user nova-compute[74421]: </disk>
Oct 23 15:28:59 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updating instance_info_cache with network_info: [{"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Releasing lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Instance network_info: |[{"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Start _get_guest_xml network_info=[{"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:28:59 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:59 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1017470389',display_name='tempest-AttachVolumeNegativeTest-server-1017470389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1017470389',id=22,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElSDPgRSbtGhMTKyud90mdSuUmBdd2KF71U0ZLJEr40z4HmRx6NoYOzfGsMBAFUUWrfooM9spQViPKzXMDBnUAbNWPOzBfx7OIzR9p/3kFzptuhJHCqyQ69vZ30kmlaWA==',key_name='tempest-keypair-746700191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-77ad6fht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=c436795b-5a83-48e8-a98c-53dbe8c28363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.objects.instance [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'pci_devices' on Instance uuid c436795b-5a83-48e8-a98c-53dbe8c28363 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:59 user nova-compute[74421]: WARNING nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state building and task_state spawning.
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:59 user nova-compute[74421]: WARNING nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state building and task_state spawning.
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:28:59 user nova-compute[74421]: WARNING nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state building and task_state spawning.
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received event network-changed-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Refreshing instance network info cache due to event network-changed-4546894b-2ab7-41ef-82bd-05848f7ebd23. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Acquiring lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Acquired lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Refreshing network info cache for port 4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:28:59 user nova-compute[74421]:   <uuid>c436795b-5a83-48e8-a98c-53dbe8c28363</uuid>
Oct 23 15:28:59 user nova-compute[74421]:   <name>instance-00000016</name>
Oct 23 15:28:59 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:28:59 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:28:59 user nova-compute[74421]:   <metadata>
Oct 23 15:28:59 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:28:59 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:28:59 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1017470389</nova:name>
Oct 23 15:28:59 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:28:59</nova:creationTime>
Oct 23 15:28:59 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:28:59 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:28:59 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:28:59 user nova-compute[74421]:       <nova:owner>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:user uuid="1e711d55fe644a0ca518fa34d187b79f">tempest-AttachVolumeNegativeTest-100322526-project-member</nova:user>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:project uuid="74e90bcb97e74feaa5e6247b7fc0d3f2">tempest-AttachVolumeNegativeTest-100322526</nova:project>
Oct 23 15:28:59 user nova-compute[74421]:       </nova:owner>
Oct 23 15:28:59 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:28:59 user nova-compute[74421]:       <nova:ports>
Oct 23 15:28:59 user nova-compute[74421]:         <nova:port uuid="4546894b-2ab7-41ef-82bd-05848f7ebd23">
Oct 23 15:28:59 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:28:59 user nova-compute[74421]:         </nova:port>
Oct 23 15:28:59 user nova-compute[74421]:       </nova:ports>
Oct 23 15:28:59 user nova-compute[74421]:     </nova:instance>
Oct 23 15:28:59 user nova-compute[74421]:   </metadata>
Oct 23 15:28:59 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:28:59 user nova-compute[74421]:     <system>
Oct 23 15:28:59 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:28:59 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:28:59 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:28:59 user nova-compute[74421]:       <entry name="serial">c436795b-5a83-48e8-a98c-53dbe8c28363</entry>
Oct 23 15:28:59 user nova-compute[74421]:       <entry name="uuid">c436795b-5a83-48e8-a98c-53dbe8c28363</entry>
Oct 23 15:28:59 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:28:59 user nova-compute[74421]:     </system>
Oct 23 15:28:59 user nova-compute[74421]:   </sysinfo>
Oct 23 15:28:59 user nova-compute[74421]:   <os>
Oct 23 15:28:59 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:28:59 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:28:59 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:28:59 user nova-compute[74421]:   </os>
Oct 23 15:28:59 user nova-compute[74421]:   <features>
Oct 23 15:28:59 user nova-compute[74421]:     <acpi/>
Oct 23 15:28:59 user nova-compute[74421]:     <apic/>
Oct 23 15:28:59 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:28:59 user nova-compute[74421]:   </features>
Oct 23 15:28:59 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:28:59 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:28:59 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:28:59 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:28:59 user nova-compute[74421]:   </clock>
Oct 23 15:28:59 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:28:59 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:28:59 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:28:59 user nova-compute[74421]:   </cpu>
Oct 23 15:28:59 user nova-compute[74421]:   <devices>
Oct 23 15:28:59 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:28:59 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:28:59 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk"/>
Oct 23 15:28:59 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:28:59 user nova-compute[74421]:     </disk>
Oct 23 15:28:59 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:28:59 user nova-compute[74421]:       <mac address="fa:16:3e:81:f1:ce"/>
Oct 23 15:28:59 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:59 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:28:59 user nova-compute[74421]:       <target dev="tap4546894b-2a"/>
Oct 23 15:28:59 user nova-compute[74421]:     </interface>
Oct 23 15:28:59 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:28:59 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/console.log" append="off"/>
Oct 23 15:28:59 user nova-compute[74421]:     </serial>
Oct 23 15:28:59 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:28:59 user nova-compute[74421]:     <video>
Oct 23 15:28:59 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:28:59 user nova-compute[74421]:     </video>
Oct 23 15:28:59 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:28:59 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:28:59 user nova-compute[74421]:     </rng>
Oct 23 15:28:59 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:28:59 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:28:59 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:28:59 user nova-compute[74421]:     </memballoon>
Oct 23 15:28:59 user nova-compute[74421]:   </devices>
Oct 23 15:28:59 user nova-compute[74421]: </domain>
Oct 23 15:28:59 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1017470389',display_name='tempest-AttachVolumeNegativeTest-server-1017470389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1017470389',id=22,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElSDPgRSbtGhMTKyud90mdSuUmBdd2KF71U0ZLJEr40z4HmRx6NoYOzfGsMBAFUUWrfooM9spQViPKzXMDBnUAbNWPOzBfx7OIzR9p/3kFzptuhJHCqyQ69vZ30kmlaWA==',key_name='tempest-keypair-746700191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-77ad6fht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:28:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=c436795b-5a83-48e8-a98c-53dbe8c28363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG os_vif [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91e424ed-8ffc-5563-ad94-9090d527f4ce', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4546894b-2a, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4546894b-2a, col_values=(('qos', UUID('31c45f12-ae45-4d81-a56e-d2116e5d909e')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4546894b-2a, col_values=(('external_ids', {'iface-id': '4546894b-2ab7-41ef-82bd-05848f7ebd23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:f1:ce', 'vm-uuid': 'c436795b-5a83-48e8-a98c-53dbe8c28363'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: INFO os_vif [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a')
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:81:f1:ce, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:28:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] No VIF found with MAC fa:16:3e:f4:5c:17, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-594d4b6f-316f-407f-abe6-35e1011318d5 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.825s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updated VIF entry in instance network info cache for port 4546894b-2ab7-41ef-82bd-05848f7ebd23. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updating instance_info_cache with network_info: [{"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a9aad7f5-ac2c-4608-978b-d6092020bb67 req-b74cc766-5a52-41b4-ba84-6754183d9648 service nova] Releasing lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:29:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance spawned successfully.
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: INFO nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Took 9.34 seconds to spawn the instance on the hypervisor.
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:29:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance spawned successfully.
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:00 user nova-compute[74421]: INFO nova.compute.manager [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Took 10.72 seconds to build instance.
Oct 23 15:29:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-59f8d007-2a7d-4f05-91b5-c4907021f12e tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.997s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:01 user nova-compute[74421]: INFO nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Took 10.93 seconds to spawn the instance on the hypervisor.
Oct 23 15:29:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:29:01 user nova-compute[74421]: INFO nova.compute.manager [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Took 12.12 seconds to build instance.
Oct 23 15:29:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-67b852cc-3fa7-4d58-9025-df280ab390a7 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.310s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-9a122180-5635-4f1a-b134-0bb2aef6f981 req-c6b23035-5d5a-4155-bffd-89c139871481 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received event network-vif-plugged-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9a122180-5635-4f1a-b134-0bb2aef6f981 req-c6b23035-5d5a-4155-bffd-89c139871481 service nova] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9a122180-5635-4f1a-b134-0bb2aef6f981 req-c6b23035-5d5a-4155-bffd-89c139871481 service nova] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9a122180-5635-4f1a-b134-0bb2aef6f981 req-c6b23035-5d5a-4155-bffd-89c139871481 service nova] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-9a122180-5635-4f1a-b134-0bb2aef6f981 req-c6b23035-5d5a-4155-bffd-89c139871481 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] No waiting events found dispatching network-vif-plugged-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:29:01 user nova-compute[74421]: WARNING nova.compute.manager [req-9a122180-5635-4f1a-b134-0bb2aef6f981 req-c6b23035-5d5a-4155-bffd-89c139871481 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received unexpected event network-vif-plugged-4546894b-2ab7-41ef-82bd-05848f7ebd23 for instance with vm_state building and task_state spawning.
Oct 23 15:29:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:02 user nova-compute[74421]: INFO nova.compute.manager [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Detaching volume d2623429-6306-4df0-bbca-8d83ba2c20b4
Oct 23 15:29:02 user nova-compute[74421]: INFO nova.virt.block_device [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Attempting to driver detach volume d2623429-6306-4df0-bbca-8d83ba2c20b4 from mountpoint /dev/vdb
Oct 23 15:29:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Attempting to detach device vdb from instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:29:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:29:02 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:29:02 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:29:02 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:29:02 user nova-compute[74421]:   <serial>d2623429-6306-4df0-bbca-8d83ba2c20b4</serial>
Oct 23 15:29:02 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:29:02 user nova-compute[74421]: </disk>
Oct 23 15:29:02 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:29:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Successfully detached device vdb from instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 from the persistent domain config.
Oct 23 15:29:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:29:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:29:02 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:29:02 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:29:02 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:29:02 user nova-compute[74421]:   <serial>d2623429-6306-4df0-bbca-8d83ba2c20b4</serial>
Oct 23 15:29:02 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:29:02 user nova-compute[74421]: </disk>
Oct 23 15:29:02 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:29:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:29:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-62da8642-7ab8-4371-a0f5-0d9dc52dd04d req-8fbb6c1f-088c-4b62-af09-31617f799224 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received event network-vif-plugged-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-62da8642-7ab8-4371-a0f5-0d9dc52dd04d req-8fbb6c1f-088c-4b62-af09-31617f799224 service nova] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-62da8642-7ab8-4371-a0f5-0d9dc52dd04d req-8fbb6c1f-088c-4b62-af09-31617f799224 service nova] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-62da8642-7ab8-4371-a0f5-0d9dc52dd04d req-8fbb6c1f-088c-4b62-af09-31617f799224 service nova] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-62da8642-7ab8-4371-a0f5-0d9dc52dd04d req-8fbb6c1f-088c-4b62-af09-31617f799224 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] No waiting events found dispatching network-vif-plugged-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:29:03 user nova-compute[74421]: WARNING nova.compute.manager [req-62da8642-7ab8-4371-a0f5-0d9dc52dd04d req-8fbb6c1f-088c-4b62-af09-31617f799224 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received unexpected event network-vif-plugged-4546894b-2ab7-41ef-82bd-05848f7ebd23 for instance with vm_state building and task_state spawning.
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:29:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Instance spawned successfully.
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:04 user nova-compute[74421]: INFO nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Took 8.39 seconds to spawn the instance on the hypervisor.
Oct 23 15:29:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:29:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:04 user nova-compute[74421]: INFO nova.compute.manager [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Took 10.43 seconds to build instance.
Oct 23 15:29:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a997567-e3e4-496a-89b4-b56657a085bc tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.664s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSCHDaLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:14 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:29:14 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:29:14 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7832f9-62ad-45e7-958c-d8e10e031cd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:29:14 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59921d-c05a-45cb-a191-66c79e78a030]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398] added
Oct 23 15:29:14 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da9bd0-3cce-4ea0-872e-a19dbcac3a51]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc129442-9cf6-489e-83a7-fcd1c071c77a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSCHDaLY {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSCHDaLY" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb7bcdc-590e-437f-8a20-85d1c2f640d9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSCHDaLY'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[19760852-3748-4bf8-9c93-6fb4dfad3035]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9becf1-7408-4b20-bd9e-3fdbcbac6ffb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e808fb6f-b79c-4a47-ab31-bca6e5be645e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260]
Oct 23 15:29:14 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260] successful.
Oct 23 15:29:14 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00abb78-2cb1-4e12-b8bc-ef7d7c127968]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af20f705-660c-41e7-9e45-2e24d5c4f8ba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)
Oct 23 15:29:14 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.074s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb08c2-bc06-4319-898a-0b8beb1b69ba]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:29:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSCHDaLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:29:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:29:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26230373635613638', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230373635613638', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:29:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'flavor' on Instance uuid ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:29:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:29:16 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:29:16 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:29:16 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:29:16 user nova-compute[74421]:   <serial>f7bade07-0820-48ed-94a4-6ecf302f6398</serial>
Oct 23 15:29:16 user nova-compute[74421]: </disk>
Oct 23 15:29:16 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:29:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:29:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:29:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No VIF found with MAC fa:16:3e:ca:4c:2a, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:29:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cf079aa5-9d2b-47fc-aa30-de399f042241 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.645s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:18 user nova-compute[74421]: INFO nova.compute.manager [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Detaching volume f7bade07-0820-48ed-94a4-6ecf302f6398
Oct 23 15:29:18 user nova-compute[74421]: INFO nova.virt.block_device [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Attempting to driver detach volume f7bade07-0820-48ed-94a4-6ecf302f6398 from mountpoint /dev/vdb
Oct 23 15:29:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Attempting to detach device vdb from instance ef24f4fa-32df-438e-bb56-ee4a0b32770c from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:29:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:29:18 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:29:18 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:29:18 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:29:18 user nova-compute[74421]:   <serial>f7bade07-0820-48ed-94a4-6ecf302f6398</serial>
Oct 23 15:29:18 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:29:18 user nova-compute[74421]: </disk>
Oct 23 15:29:18 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:29:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Successfully detached device vdb from instance ef24f4fa-32df-438e-bb56-ee4a0b32770c from the persistent domain config.
Oct 23 15:29:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef24f4fa-32df-438e-bb56-ee4a0b32770c from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:29:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:29:18 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:29:18 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:29:18 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:29:18 user nova-compute[74421]:   <serial>f7bade07-0820-48ed-94a4-6ecf302f6398</serial>
Oct 23 15:29:18 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:29:18 user nova-compute[74421]: </disk>
Oct 23 15:29:18 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:29:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:29:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:23 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 is timed out.
Oct 23 15:29:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Successfully detached device vdb from instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 from the live domain config.
Oct 23 15:29:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDXhCmAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:23 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7df44a2-7773-448c-a7ee-9a5ebb5bc7d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:29:23 user nova-compute[74421]: No targets found.
Oct 23 15:29:23 user nova-compute[74421]: iSNS:
Oct 23 15:29:23 user nova-compute[74421]: No targets found.
Oct 23 15:29:23 user nova-compute[74421]: STATIC:
Oct 23 15:29:23 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:29:23 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:23 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:23 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:29:23 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:23 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:23 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398
Oct 23 15:29:23 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:23 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:23 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:29:23 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:23 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:23 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4
Oct 23 15:29:23 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:23 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:23 user nova-compute[74421]: FIRMWARE:
Oct 23 15:29:23 user nova-compute[74421]: No targets found.
Oct 23 15:29:23 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:29:23 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:29:23 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c560d28-609e-4a97-9591-63e98bc8c63e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b5baec-7755-424b-a6a6-36b3bb2e98d1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)
Oct 23 15:29:23 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2480401090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e43877-663f-4822-99e7-752b877045c2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16628d-7986-4c4a-8a20-9c6bcd2751fb]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87ccac-e44f-44c6-8d30-c2d2482f7fde]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fe6b6-a80e-451d-a219-f0e4b8dd5aee]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be220fb-cef4-47b8-a75a-9aed3c068aab]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b1844-dd0f-47c1-be53-a04c71057029]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260]
Oct 23 15:29:23 user nova-compute[74421]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4, portal: 172.16.0.220,3260] successful.
Oct 23 15:29:23 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2623429-6306-4df0-bbca-8d83ba2c20b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a8934-042c-4a87-967c-02625033d92f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] <== disconnect_volume: return (365ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:29:24 user nova-compute[74421]: DEBUG nova.objects.instance [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lazy-loading 'flavor' on Instance uuid 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:29:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7348f7d2-e353-4ddd-a870-fec4a937c8b0 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.029s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:29:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:28 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:29:28 user nova-compute[74421]: INFO nova.compute.claims [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Claim successful on node user
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:29:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:29:29 user nova-compute[74421]: INFO nova.virt.block_device [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Booting with volume a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 at /dev/vda
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.policy [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5300248ea78420c8cacd668de1f8932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c929d756f2f54ce4bceb88868166e598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG os_brick.utils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d913575-ab28-4dc7-a8a1-04afee19c4b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af45092-32dd-4160-becb-6a5dc0ecd9b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[88026404-0dfd-4424-bc00-8685f8daddd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce1fdc-c5ec-480b-8261-b8aec24222cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:29 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:29:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[45023fd8-8866-4cb5-9e1a-e1f289996821]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG os_brick.utils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating existing volume attachment record: 3473183c-82ef-4830-8f22-be5c79e79677 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully created port: dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:29:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully created port: f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:29:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully created port: df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:29:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully created port: 02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:29:32 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully created port: ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:29:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-changed-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Refreshing instance network info cache due to event network-changed-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] Acquiring lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] Acquired lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Refreshing network info cache for port b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-dd27138c-0c34-4091-a864-fb081149be7d. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lazy-loading 'flavor' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:33 user nova-compute[74421]: INFO nova.compute.manager [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Attaching volume 6beb0bbd-b464-4303-b817-548429ed2ee6 to /dev/vdb
Oct 23 15:29:33 user nova-compute[74421]: DEBUG os_brick.utils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5f08a-1dae-4a27-a771-766bebf173ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b605bbba-55ba-48c1-83d8-10f4271acb30 req-3f928b19-05ec-49fa-9d86-b319abdcd9bc service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4278b72-0ea5-4cca-9df3-dde90cb26b81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[54257c2f-9e5c-4716-ab9d-571fa1e2551e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438fa9f-ff05-467e-bf03-fee4df1a3c35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Updated VIF entry in instance network info cache for port b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Updating instance_info_cache with network_info: [{"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2ba6ed17-a7ca-489c-89ab-c3677d197ae3 req-dcd095de-bd7a-48dd-899f-0f24fa3f8279 service nova] Releasing lock "refresh_cache-5ceb34be-c948-47d5-9efe-11c8e25a7ceb" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:33 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:29:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25b4f3-648a-4ca2-a8f3-a96a0028a19e]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG os_brick.utils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Updating existing volume attachment record: f413c5b4-e678-43b9-b95e-6157386a3249 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:29:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: 506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: 7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-506ec095-0405-4a3f-aa55-b5b69ee1b40a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port 506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-7e84e93c-a147-4453-ba0e-6109068ca0d9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port 7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-f14032b2-c829-4282-b534-6fa8bee39902. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG nova.network.neutron [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d762799f-9bf9-4cac-aa33-5a2690fe2958 req-f38b6b17-317b-4cd6-8af2-650aaac1974a service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:36 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: 02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-df6223ec-5382-483f-b5ca-f3935d48f1f6. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Successfully updated port: ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-02c54509-9397-4304-af9f-57db3a519762. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port 02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-07b17b0d-78f1-4fba-8466-6093f6942756 req-98166a89-bd03-42df-8e3f-c4d17fdd9195 service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:37 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:29:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:29:39 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef24f4fa-32df-438e-bb56-ee4a0b32770c is timed out.
Oct 23 15:29:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Successfully detached device vdb from instance ef24f4fa-32df-438e-bb56-ee4a0b32770c from the live domain config.
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSCHDaLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:39 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[745534ee-0c8f-4faf-b311-d63173b51b7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:29:39 user nova-compute[74421]: No targets found.
Oct 23 15:29:39 user nova-compute[74421]: iSNS:
Oct 23 15:29:39 user nova-compute[74421]: No targets found.
Oct 23 15:29:39 user nova-compute[74421]: STATIC:
Oct 23 15:29:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:29:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:29:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398
Oct 23 15:29:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:29:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:29:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:29:39 user nova-compute[74421]: FIRMWARE:
Oct 23 15:29:39 user nova-compute[74421]: No targets found.
Oct 23 15:29:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:29:39 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:29:39 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3c7c2-010f-4148-a137-3b143a3527dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb742c6-6ffc-44d7-9563-4726d63847cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 (non-flash)
Oct 23 15:29:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24802b76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398'): ({'sdf'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Removing single pathed devices sdf {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf6da98-a650-4f84-b548-f93dee761183]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6f61b8-0760-4cb4-9af2-6ce82551cd47]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Flushing IO for device /dev/sdf {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678a522-faa5-48c5-9663-8938e6eca710]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13ed88-daf3-49c5-8705-d22e4170afd5]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf9851-ade1-4807-ae0b-ddea4a99a218]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4658484a-a6e3-46a8-9402-55c45bf79633]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260]
Oct 23 15:29:39 user nova-compute[74421]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398, portal: 172.16.0.220,3260] successful.
Oct 23 15:29:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7bade07-0820-48ed-94a4-6ecf302f6398 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f403204-469f-44df-ac07-fc091d6e70f3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] <== disconnect_volume: return (369ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [{"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance network_info: |[{"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:39 user nova-compute[74421]: DEBUG nova.network.neutron [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:29:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updated VIF entry in instance network info cache for port ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:29:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [{"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4c5871eb-3a2e-4be3-a4aa-994ea0d11b65 req-3a7d8c70-e026-467b-ada3-faf889e6b0d2 service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Skipping network cache update for instance because it is Building. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 110e0389-5c67-43c8-adff-dc9af9eff34e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updating instance_info_cache with network_info: [{"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-110e0389-5c67-43c8-adff-dc9af9eff34e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:44 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'flavor' on Instance uuid ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a08dabcd-059e-4876-9dc7-50207db59b48 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.042s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: INFO nova.virt.block_device [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Booting with volume 4351761a-c02a-42ec-a35f-8172df04b9aa at /dev/vdb
Oct 23 15:29:48 user nova-compute[74421]: DEBUG os_brick.utils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f19471d-00b5-4db1-879c-7f6a85e07e0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ec518-04a7-4bd8-a7b9-5a336f9ea36c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8920c84-4827-491a-a150-378ccee70a9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aabbfb-716f-41d8-b857-bd271dc5a14c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:48 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c877e7-d874-44c1-9063-85c8e2c8e07b]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG os_brick.utils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating existing volume attachment record: 47fcc8f1-924c-42d2-8783-7dce24ad720f {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:29:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=6901MB free_disk=25.132415771484375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 110e0389-5c67-43c8-adff-dc9af9eff34e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef24f4fa-32df-438e-bb56-ee4a0b32770c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance dcb2df43-8338-412d-b3f6-e506fea10603 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance c436795b-5a83-48e8-a98c-53dbe8c28363 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 88cd91e1-d137-456b-8e26-cf3af34897e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:29:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:29:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:29:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:29:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:29:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:52 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:29:52 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:29:52 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[99079481-20fe-46f6-aecd-6de44d62c7f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:29:52 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e419fe-4975-48ea-b42f-8fdf77b2acce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6] added
Oct 23 15:29:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[71702076-9114-4f64-9018-5450d9d7b522]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3dbc89-13cd-4d10-a11a-8eed94fba500]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTFKMlat {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTFKMlat" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cfab43-29d6-4b91-87a9-12c81ed7575b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTFKMlat'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba564e8b-0ada-436f-9579-250aaa29023b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[314663e7-26e2-48f6-9ef5-58c57e8cdfe9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7151f2-7cd8-4577-8871-d6606d1bffbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]
Oct 23 15:29:52 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.
Oct 23 15:29:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d482cc0f-d91e-4218-bb3e-56e956f8eb6c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e08d90-cc4a-4d5d-9067-5296335a5cf5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:29:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8c460f-88d2-411e-be16-6ada3f49eb3d]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:29:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26631373462353962', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631373462353962', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lazy-loading 'flavor' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:29:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:29:53 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:29:53 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:29:53 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:29:53 user nova-compute[74421]:   <serial>6beb0bbd-b464-4303-b817-548429ed2ee6</serial>
Oct 23 15:29:53 user nova-compute[74421]: </disk>
Oct 23 15:29:53 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:29:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:29:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:29:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] No VIF found with MAC fa:16:3e:00:22:57, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:29:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ca93c1d1-d2aa-4ebf-8c8b-6029f62e66bd tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.906s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:29:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG os_brick.utils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933e394-45bc-42e7-a290-a4966ed84600]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[90875b20-608d-42e0-9e54-442abd66db5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ad651-35ff-49ab-a84c-b4684da7e685]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[52841eb4-9fa8-4dec-8c81-320c06cd7878]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:29:55 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:29:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a115c86e-c077-48a4-8374-7c64a90172c0]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:29:55 user nova-compute[74421]: DEBUG os_brick.utils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:29:56 user nova-compute[74421]: INFO nova.compute.manager [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Swapping volume 6beb0bbd-b464-4303-b817-548429ed2ee6 for 61ca7893-0c16-4070-9af4-6a229614a64c
Oct 23 15:29:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:29:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:30:02 user nova-compute[74421]: INFO nova.compute.claims [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Claim successful on node user
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:30:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:30:02 user nova-compute[74421]: DEBUG nova.policy [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44dbafa0de4741f6b2b899192d589bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02848acb11c4ded852539e27b5a9d9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:30:03 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Creating image(s)
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "/opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "/opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "/opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:03 user nova-compute[74421]: INFO nova.compute.manager [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Terminating instance
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.234s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-0465602d-3d7d-4877-853f-99fbe02de17e req-e7633b4e-149f-4fad-b553-7af728eea8b5 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-vif-unplugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0465602d-3d7d-4877-853f-99fbe02de17e req-e7633b4e-149f-4fad-b553-7af728eea8b5 service nova] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0465602d-3d7d-4877-853f-99fbe02de17e req-e7633b4e-149f-4fad-b553-7af728eea8b5 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0465602d-3d7d-4877-853f-99fbe02de17e req-e7633b4e-149f-4fad-b553-7af728eea8b5 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-0465602d-3d7d-4877-853f-99fbe02de17e req-e7633b4e-149f-4fad-b553-7af728eea8b5 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] No waiting events found dispatching network-vif-unplugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-0465602d-3d7d-4877-853f-99fbe02de17e req-e7633b4e-149f-4fad-b553-7af728eea8b5 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-vif-unplugged-e31e3015-9410-4ee0-ac86-52b2dc900289 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk 1073741824" returned: 0 in 0.056s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Successfully created port: 1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Cannot resize image /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Ensure instance console log exists: /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:03 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Instance destroyed successfully.
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.objects.instance [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lazy-loading 'resources' on Instance uuid 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-720124797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7201247',id=16,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyBc8EP8/qnHv0VvOcjfwanHlfUZiARLJrAtpgkgnTRWKzCvUyKPYnSMoChQ14gByBV1umt1pzlW95lkpaz4GAcZrKds7EW66emUb7PUhcTE4horK9x1aaMOrA4bZK4qQ==',key_name='tempest-keypair-712253721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0fe2b9ed6a475db57eb0776af27512',ramdisk_id='',reservation_id='r-am1v33kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-568703167',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd080c04ce224a4dbad1e611513ac25e',uuid=8d6ead20-f082-416a-a1f4-7e680e3ad9b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Converting VIF {"id": "e31e3015-9410-4ee0-ac86-52b2dc900289", "address": "fa:16:3e:f4:5c:17", "network": {"id": "403c2282-6429-4755-9983-32a0bc5f8f46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1366920355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0fe2b9ed6a475db57eb0776af27512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31e3015-94", "ovs_interfaceid": "e31e3015-9410-4ee0-ac86-52b2dc900289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:03 user nova-compute[74421]: DEBUG os_vif [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape31e3015-94, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6b5031d-f7c7-4215-81a5-a45e9433625d) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:04 user nova-compute[74421]: INFO os_vif [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=e31e3015-9410-4ee0-ac86-52b2dc900289,network=Network(403c2282-6429-4755-9983-32a0bc5f8f46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31e3015-94')
Oct 23 15:30:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Deleting instance files /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7_del
Oct 23 15:30:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Deletion of /opt/stack/data/nova/instances/8d6ead20-f082-416a-a1f4-7e680e3ad9b7_del complete
Oct 23 15:30:04 user nova-compute[74421]: INFO nova.compute.manager [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Successfully updated port: 1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "refresh_cache-980791bd-c51d-4cf5-b72b-dd2262fc1f82" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquired lock "refresh_cache-980791bd-c51d-4cf5-b72b-dd2262fc1f82" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-changed-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Refreshing instance network info cache due to event network-changed-1420182e-b77f-4c78-9b8c-f779cc342ebe. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] Acquiring lock "refresh_cache-980791bd-c51d-4cf5-b72b-dd2262fc1f82" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Updating instance_info_cache with network_info: [{"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Releasing lock "refresh_cache-980791bd-c51d-4cf5-b72b-dd2262fc1f82" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Instance network_info: |[{"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] Acquired lock "refresh_cache-980791bd-c51d-4cf5-b72b-dd2262fc1f82" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Refreshing network info cache for port 1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Start _get_guest_xml network_info=[{"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:04 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1508700186',display_name='tempest-VolumesActionsTest-instance-1508700186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1508700186',id=24,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02848acb11c4ded852539e27b5a9d9f',ramdisk_id='',reservation_id='r-m1smf89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-389153627',owner_user_name='tempest-VolumesActionsTest-389153627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:30:03Z,user_data=None,user_id='44dbafa0de4741f6b2b899192d589bae',uuid=980791bd-c51d-4cf5-b72b-dd2262fc1f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Converting VIF {"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.objects.instance [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lazy-loading 'pci_devices' on Instance uuid 980791bd-c51d-4cf5-b72b-dd2262fc1f82 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-97675b52-f242-4402-868b-66b377e7dd6f req-908eed55-36d3-4ac3-886f-f65ccdc4e82f service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-vif-deleted-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:04 user nova-compute[74421]: INFO nova.compute.manager [req-97675b52-f242-4402-868b-66b377e7dd6f req-908eed55-36d3-4ac3-886f-f65ccdc4e82f service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Neutron deleted interface e31e3015-9410-4ee0-ac86-52b2dc900289; detaching it from the instance and deleting it from the info cache
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-97675b52-f242-4402-868b-66b377e7dd6f req-908eed55-36d3-4ac3-886f-f65ccdc4e82f service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:30:04 user nova-compute[74421]:   <uuid>980791bd-c51d-4cf5-b72b-dd2262fc1f82</uuid>
Oct 23 15:30:04 user nova-compute[74421]:   <name>instance-00000018</name>
Oct 23 15:30:04 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:30:04 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:30:04 user nova-compute[74421]:   <metadata>
Oct 23 15:30:04 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:30:04 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:30:04 user nova-compute[74421]:       <nova:name>tempest-VolumesActionsTest-instance-1508700186</nova:name>
Oct 23 15:30:04 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:30:04</nova:creationTime>
Oct 23 15:30:04 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:30:04 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:30:04 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:30:04 user nova-compute[74421]:       <nova:owner>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:user uuid="44dbafa0de4741f6b2b899192d589bae">tempest-VolumesActionsTest-389153627-project-member</nova:user>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:project uuid="d02848acb11c4ded852539e27b5a9d9f">tempest-VolumesActionsTest-389153627</nova:project>
Oct 23 15:30:04 user nova-compute[74421]:       </nova:owner>
Oct 23 15:30:04 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:30:04 user nova-compute[74421]:       <nova:ports>
Oct 23 15:30:04 user nova-compute[74421]:         <nova:port uuid="1420182e-b77f-4c78-9b8c-f779cc342ebe">
Oct 23 15:30:04 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:30:04 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:04 user nova-compute[74421]:       </nova:ports>
Oct 23 15:30:04 user nova-compute[74421]:     </nova:instance>
Oct 23 15:30:04 user nova-compute[74421]:   </metadata>
Oct 23 15:30:04 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:30:04 user nova-compute[74421]:     <system>
Oct 23 15:30:04 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:30:04 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:30:04 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:30:04 user nova-compute[74421]:       <entry name="serial">980791bd-c51d-4cf5-b72b-dd2262fc1f82</entry>
Oct 23 15:30:04 user nova-compute[74421]:       <entry name="uuid">980791bd-c51d-4cf5-b72b-dd2262fc1f82</entry>
Oct 23 15:30:04 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:30:04 user nova-compute[74421]:     </system>
Oct 23 15:30:04 user nova-compute[74421]:   </sysinfo>
Oct 23 15:30:04 user nova-compute[74421]:   <os>
Oct 23 15:30:04 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:30:04 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:30:04 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:30:04 user nova-compute[74421]:   </os>
Oct 23 15:30:04 user nova-compute[74421]:   <features>
Oct 23 15:30:04 user nova-compute[74421]:     <acpi/>
Oct 23 15:30:04 user nova-compute[74421]:     <apic/>
Oct 23 15:30:04 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:30:04 user nova-compute[74421]:   </features>
Oct 23 15:30:04 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:30:04 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:30:04 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:30:04 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:30:04 user nova-compute[74421]:   </clock>
Oct 23 15:30:04 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:30:04 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:30:04 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:30:04 user nova-compute[74421]:   </cpu>
Oct 23 15:30:04 user nova-compute[74421]:   <devices>
Oct 23 15:30:04 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:30:04 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:30:04 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk"/>
Oct 23 15:30:04 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:30:04 user nova-compute[74421]:     </disk>
Oct 23 15:30:04 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:04 user nova-compute[74421]:       <mac address="fa:16:3e:6c:f2:54"/>
Oct 23 15:30:04 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:04 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:04 user nova-compute[74421]:       <target dev="tap1420182e-b7"/>
Oct 23 15:30:04 user nova-compute[74421]:     </interface>
Oct 23 15:30:04 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:30:04 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/console.log" append="off"/>
Oct 23 15:30:04 user nova-compute[74421]:     </serial>
Oct 23 15:30:04 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:30:04 user nova-compute[74421]:     <video>
Oct 23 15:30:04 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:04 user nova-compute[74421]:     </video>
Oct 23 15:30:04 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:30:04 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:30:04 user nova-compute[74421]:     </rng>
Oct 23 15:30:04 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:30:04 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:30:04 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:30:04 user nova-compute[74421]:     </memballoon>
Oct 23 15:30:04 user nova-compute[74421]:   </devices>
Oct 23 15:30:04 user nova-compute[74421]: </domain>
Oct 23 15:30:04 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1508700186',display_name='tempest-VolumesActionsTest-instance-1508700186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1508700186',id=24,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02848acb11c4ded852539e27b5a9d9f',ramdisk_id='',reservation_id='r-m1smf89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-389153627',owner_user_name='tempest-VolumesActionsTest-389153627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:30:03Z,user_data=None,user_id='44dbafa0de4741f6b2b899192d589bae',uuid=980791bd-c51d-4cf5-b72b-dd2262fc1f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Converting VIF {"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG os_vif [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5e12587-071d-54fd-87ce-23a2735849ce', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Took 0.77 seconds to deallocate network for instance.
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-97675b52-f242-4402-868b-66b377e7dd6f req-908eed55-36d3-4ac3-886f-f65ccdc4e82f service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Detach interface failed, port_id=e31e3015-9410-4ee0-ac86-52b2dc900289, reason: Instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1420182e-b7, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1420182e-b7, col_values=(('qos', UUID('37d863c6-4f19-4776-bcf5-d977adabb408')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1420182e-b7, col_values=(('external_ids', {'iface-id': '1420182e-b77f-4c78-9b8c-f779cc342ebe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:f2:54', 'vm-uuid': '980791bd-c51d-4cf5-b72b-dd2262fc1f82'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:04 user nova-compute[74421]: INFO os_vif [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7')
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] No VIF found with MAC fa:16:3e:6c:f2:54, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Updated VIF entry in instance network info cache for port 1420182e-b77f-4c78-9b8c-f779cc342ebe. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Updating instance_info_cache with network_info: [{"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b6d2252-fd9d-4730-8c08-caff0b8ce0d4 req-5cd351a9-600a-4312-994c-7c1a477b6ffa service nova] Releasing lock "refresh_cache-980791bd-c51d-4cf5-b72b-dd2262fc1f82" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-c4af3075-2c5e-4514-9edd-6057b7be51e5 req-47d0cda3-0677-4789-aab1-eca413abd072 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received event network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c4af3075-2c5e-4514-9edd-6057b7be51e5 req-47d0cda3-0677-4789-aab1-eca413abd072 service nova] Acquiring lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c4af3075-2c5e-4514-9edd-6057b7be51e5 req-47d0cda3-0677-4789-aab1-eca413abd072 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c4af3075-2c5e-4514-9edd-6057b7be51e5 req-47d0cda3-0677-4789-aab1-eca413abd072 service nova] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-c4af3075-2c5e-4514-9edd-6057b7be51e5 req-47d0cda3-0677-4789-aab1-eca413abd072 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] No waiting events found dispatching network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:05 user nova-compute[74421]: WARNING nova.compute.manager [req-c4af3075-2c5e-4514-9edd-6057b7be51e5 req-47d0cda3-0677-4789-aab1-eca413abd072 service nova] [instance: 8d6ead20-f082-416a-a1f4-7e680e3ad9b7] Received unexpected event network-vif-plugged-e31e3015-9410-4ee0-ac86-52b2dc900289 for instance with vm_state deleted and task_state None.
Oct 23 15:30:05 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Deleted allocations for instance 8d6ead20-f082-416a-a1f4-7e680e3ad9b7
Oct 23 15:30:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-acb3df24-8c26-490e-abed-79fca72b8c14 tempest-TestServerVolumeAttachScenarioOldVersion-568703167 tempest-TestServerVolumeAttachScenarioOldVersion-568703167-project-member] Lock "8d6ead20-f082-416a-a1f4-7e680e3ad9b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-c32cb6ab-81fd-4c17-9aed-6c2a76e256cf req-9fe66030-1f01-466a-acfa-b81af1714aaf service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c32cb6ab-81fd-4c17-9aed-6c2a76e256cf req-9fe66030-1f01-466a-acfa-b81af1714aaf service nova] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c32cb6ab-81fd-4c17-9aed-6c2a76e256cf req-9fe66030-1f01-466a-acfa-b81af1714aaf service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c32cb6ab-81fd-4c17-9aed-6c2a76e256cf req-9fe66030-1f01-466a-acfa-b81af1714aaf service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-c32cb6ab-81fd-4c17-9aed-6c2a76e256cf req-9fe66030-1f01-466a-acfa-b81af1714aaf service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] No waiting events found dispatching network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:07 user nova-compute[74421]: WARNING nova.compute.manager [req-c32cb6ab-81fd-4c17-9aed-6c2a76e256cf req-9fe66030-1f01-466a-acfa-b81af1714aaf service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received unexpected event network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe for instance with vm_state building and task_state spawning.
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:30:08 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Instance spawned successfully.
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:08 user nova-compute[74421]: INFO nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 23 15:30:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:30:08 user nova-compute[74421]: INFO nova.compute.manager [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Took 6.72 seconds to build instance.
Oct 23 15:30:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-44e80266-744f-4148-9e03-de74f3b04988 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.830s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:09 user nova-compute[74421]: INFO nova.virt.block_device [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Booting with volume a6b803a2-7485-4f08-b5b7-f845312d5352 at /dev/vdc
Oct 23 15:30:09 user nova-compute[74421]: DEBUG os_brick.utils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45ef079-0ecb-4ba5-b642-f649d431f7e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3406af77-c3c9-4488-a2bf-7762e5fd6ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-9321c64d-3f44-4e06-8116-4d945aa4d334 req-8f9d3260-9103-4393-8bc6-4d79fc5196df service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9321c64d-3f44-4e06-8116-4d945aa4d334 req-8f9d3260-9103-4393-8bc6-4d79fc5196df service nova] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9321c64d-3f44-4e06-8116-4d945aa4d334 req-8f9d3260-9103-4393-8bc6-4d79fc5196df service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9321c64d-3f44-4e06-8116-4d945aa4d334 req-8f9d3260-9103-4393-8bc6-4d79fc5196df service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-9321c64d-3f44-4e06-8116-4d945aa4d334 req-8f9d3260-9103-4393-8bc6-4d79fc5196df service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] No waiting events found dispatching network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:09 user nova-compute[74421]: WARNING nova.compute.manager [req-9321c64d-3f44-4e06-8116-4d945aa4d334 req-8f9d3260-9103-4393-8bc6-4d79fc5196df service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received unexpected event network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe for instance with vm_state active and task_state None.
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b38942d-088b-4664-bd09-06d10900474e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[559fefe1-384f-4fc4-8b59-14d73be5d97d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:30:09 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:30:09 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96af3b8-d447-4950-9f31-46cf60da3ad9]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG os_brick.utils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating existing volume attachment record: e93a5589-5adc-4512-86fb-6bfdc6698fe2 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:30:10 user nova-compute[74421]: INFO nova.compute.claims [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Claim successful on node user
Oct 23 15:30:10 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:30:11 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.policy [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfeb2fd3197444f89abc351a2ac1dfa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf1350aabad4540a2afb76a166a3a0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:30:11 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Creating image(s)
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "/opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "/opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "/opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.223s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk 1073741824" returned: 0 in 0.072s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Successfully created port: 1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Cannot resize image /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Ensure instance console log exists: /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Successfully updated port: 1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "refresh_cache-db43eba9-ae25-4e37-8554-39d67abe06b1" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquired lock "refresh_cache-db43eba9-ae25-4e37-8554-39d67abe06b1" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-changed-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Refreshing instance network info cache due to event network-changed-1afd6b20-961f-4a00-ab48-6bc5a97d6acc. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] Acquiring lock "refresh_cache-db43eba9-ae25-4e37-8554-39d67abe06b1" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Updating instance_info_cache with network_info: [{"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Releasing lock "refresh_cache-db43eba9-ae25-4e37-8554-39d67abe06b1" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Instance network_info: |[{"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] Acquired lock "refresh_cache-db43eba9-ae25-4e37-8554-39d67abe06b1" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Refreshing network info cache for port 1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Start _get_guest_xml network_info=[{"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:30:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-268343569',display_name='tempest-VolumesAdminNegativeTest-server-268343569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-268343569',id=25,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf1350aabad4540a2afb76a166a3a0e',ramdisk_id='',reservation_id='r-248kjmms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1598499002',owner_user_name='tempest-VolumesAdminNegativeTest-1598499002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:30:11Z,user_data=None,user_id='bfeb2fd3197444f89abc351a2ac1dfa6',uuid=db43eba9-ae25-4e37-8554-39d67abe06b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converting VIF {"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'pci_devices' on Instance uuid db43eba9-ae25-4e37-8554-39d67abe06b1 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:30:13 user nova-compute[74421]:   <uuid>db43eba9-ae25-4e37-8554-39d67abe06b1</uuid>
Oct 23 15:30:13 user nova-compute[74421]:   <name>instance-00000019</name>
Oct 23 15:30:13 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:30:13 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:30:13 user nova-compute[74421]:   <metadata>
Oct 23 15:30:13 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:30:13 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:30:13 user nova-compute[74421]:       <nova:name>tempest-VolumesAdminNegativeTest-server-268343569</nova:name>
Oct 23 15:30:13 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:30:13</nova:creationTime>
Oct 23 15:30:13 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:30:13 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:30:13 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:30:13 user nova-compute[74421]:       <nova:owner>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:user uuid="bfeb2fd3197444f89abc351a2ac1dfa6">tempest-VolumesAdminNegativeTest-1598499002-project-member</nova:user>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:project uuid="fdf1350aabad4540a2afb76a166a3a0e">tempest-VolumesAdminNegativeTest-1598499002</nova:project>
Oct 23 15:30:13 user nova-compute[74421]:       </nova:owner>
Oct 23 15:30:13 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:30:13 user nova-compute[74421]:       <nova:ports>
Oct 23 15:30:13 user nova-compute[74421]:         <nova:port uuid="1afd6b20-961f-4a00-ab48-6bc5a97d6acc">
Oct 23 15:30:13 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:30:13 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:13 user nova-compute[74421]:       </nova:ports>
Oct 23 15:30:13 user nova-compute[74421]:     </nova:instance>
Oct 23 15:30:13 user nova-compute[74421]:   </metadata>
Oct 23 15:30:13 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:30:13 user nova-compute[74421]:     <system>
Oct 23 15:30:13 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:30:13 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:30:13 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:30:13 user nova-compute[74421]:       <entry name="serial">db43eba9-ae25-4e37-8554-39d67abe06b1</entry>
Oct 23 15:30:13 user nova-compute[74421]:       <entry name="uuid">db43eba9-ae25-4e37-8554-39d67abe06b1</entry>
Oct 23 15:30:13 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:30:13 user nova-compute[74421]:     </system>
Oct 23 15:30:13 user nova-compute[74421]:   </sysinfo>
Oct 23 15:30:13 user nova-compute[74421]:   <os>
Oct 23 15:30:13 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:30:13 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:30:13 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:30:13 user nova-compute[74421]:   </os>
Oct 23 15:30:13 user nova-compute[74421]:   <features>
Oct 23 15:30:13 user nova-compute[74421]:     <acpi/>
Oct 23 15:30:13 user nova-compute[74421]:     <apic/>
Oct 23 15:30:13 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:30:13 user nova-compute[74421]:   </features>
Oct 23 15:30:13 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:30:13 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:30:13 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:30:13 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:30:13 user nova-compute[74421]:   </clock>
Oct 23 15:30:13 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:30:13 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:30:13 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:30:13 user nova-compute[74421]:   </cpu>
Oct 23 15:30:13 user nova-compute[74421]:   <devices>
Oct 23 15:30:13 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:30:13 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:30:13 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk"/>
Oct 23 15:30:13 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:30:13 user nova-compute[74421]:     </disk>
Oct 23 15:30:13 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:13 user nova-compute[74421]:       <mac address="fa:16:3e:f5:c6:1e"/>
Oct 23 15:30:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:13 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:13 user nova-compute[74421]:       <target dev="tap1afd6b20-96"/>
Oct 23 15:30:13 user nova-compute[74421]:     </interface>
Oct 23 15:30:13 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:30:13 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/console.log" append="off"/>
Oct 23 15:30:13 user nova-compute[74421]:     </serial>
Oct 23 15:30:13 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:30:13 user nova-compute[74421]:     <video>
Oct 23 15:30:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:13 user nova-compute[74421]:     </video>
Oct 23 15:30:13 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:30:13 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:30:13 user nova-compute[74421]:     </rng>
Oct 23 15:30:13 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:30:13 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:30:13 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:30:13 user nova-compute[74421]:     </memballoon>
Oct 23 15:30:13 user nova-compute[74421]:   </devices>
Oct 23 15:30:13 user nova-compute[74421]: </domain>
Oct 23 15:30:13 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-268343569',display_name='tempest-VolumesAdminNegativeTest-server-268343569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-268343569',id=25,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf1350aabad4540a2afb76a166a3a0e',ramdisk_id='',reservation_id='r-248kjmms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1598499002',owner_user_name='tempest-VolumesAdminNegativeTest-1598499002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:30:11Z,user_data=None,user_id='bfeb2fd3197444f89abc351a2ac1dfa6',uuid=db43eba9-ae25-4e37-8554-39d67abe06b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converting VIF {"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG os_vif [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e6b532f-a1c0-5426-a882-2b0459273c79', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1afd6b20-96, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1afd6b20-96, col_values=(('qos', UUID('68e6041e-2d31-43f6-9300-1aa82b42ee64')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1afd6b20-96, col_values=(('external_ids', {'iface-id': '1afd6b20-961f-4a00-ab48-6bc5a97d6acc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c6:1e', 'vm-uuid': 'db43eba9-ae25-4e37-8554-39d67abe06b1'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:13 user nova-compute[74421]: INFO os_vif [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96')
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] No VIF found with MAC fa:16:3e:f5:c6:1e, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Updated VIF entry in instance network info cache for port 1afd6b20-961f-4a00-ab48-6bc5a97d6acc. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Updating instance_info_cache with network_info: [{"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9b64bd4c-ff5a-4693-9f51-0b5d4b587517 req-b896d89e-e7f2-4432-b145-c13aab5d55fe service nova] Releasing lock "refresh_cache-db43eba9-ae25-4e37-8554-39d67abe06b1" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-96ede334-7c51-413b-87a4-6e8e46bdc8c5 req-6ebb3044-cbff-42d1-91d0-0611b799456c service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96ede334-7c51-413b-87a4-6e8e46bdc8c5 req-6ebb3044-cbff-42d1-91d0-0611b799456c service nova] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96ede334-7c51-413b-87a4-6e8e46bdc8c5 req-6ebb3044-cbff-42d1-91d0-0611b799456c service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96ede334-7c51-413b-87a4-6e8e46bdc8c5 req-6ebb3044-cbff-42d1-91d0-0611b799456c service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-96ede334-7c51-413b-87a4-6e8e46bdc8c5 req-6ebb3044-cbff-42d1-91d0-0611b799456c service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] No waiting events found dispatching network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:15 user nova-compute[74421]: WARNING nova.compute.manager [req-96ede334-7c51-413b-87a4-6e8e46bdc8c5 req-6ebb3044-cbff-42d1-91d0-0611b799456c service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received unexpected event network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc for instance with vm_state building and task_state spawning.
Oct 23 15:30:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLldfCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb', 'attached_at': '', 'detached_at': '', 'volume_id': '61ca7893-0c16-4070-9af4-6a229614a64c', 'serial': '61ca7893-0c16-4070-9af4-6a229614a64c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb', 'attached_at': '', 'detached_at': '', 'volume_id': '6beb0bbd-b464-4303-b817-548429ed2ee6', 'serial'} {{(pid=74421) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLldfCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:15 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:15 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:15 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[60467e2a-e8b6-422f-aa0c-6e71d09a0332]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:30:15 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b14b68-9c9e-49b9-8a57-78fed4d2b60e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c] added
Oct 23 15:30:15 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c127d-1a69-4c1b-a3f3-6bd30fbfaba4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cb978a-92c4-4d81-b8b2-702a886b0c15]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLldfCgy {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLldfCgy" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5759b15-23ba-4de3-a215-3e2e33408516]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GLldfCgy'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ed1fa-7a53-4c14-907d-f24b59667254]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c2a41e-f511-4462-b2cf-e388971ebbcd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:15 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb3450-747b-4960-a766-7bd727787a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260]
Oct 23 15:30:16 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52b216c-69f7-4084-bbfa-523b2f699b72]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0407f21-5aad-4a7f-8bbd-0c27f6a467e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:16 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1faa32-8bf0-4e53-8e79-866db2367ef5]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-d93aaf19-24f9-47a0-8881-5772967aff7d req-ab56b092-83f1-4575-8845-ef426cd0ddf0 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d93aaf19-24f9-47a0-8881-5772967aff7d req-ab56b092-83f1-4575-8845-ef426cd0ddf0 service nova] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d93aaf19-24f9-47a0-8881-5772967aff7d req-ab56b092-83f1-4575-8845-ef426cd0ddf0 service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d93aaf19-24f9-47a0-8881-5772967aff7d req-ab56b092-83f1-4575-8845-ef426cd0ddf0 service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-d93aaf19-24f9-47a0-8881-5772967aff7d req-ab56b092-83f1-4575-8845-ef426cd0ddf0 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] No waiting events found dispatching network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:17 user nova-compute[74421]: WARNING nova.compute.manager [req-d93aaf19-24f9-47a0-8881-5772967aff7d req-ab56b092-83f1-4575-8845-ef426cd0ddf0 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received unexpected event network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc for instance with vm_state building and task_state spawning.
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:30:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Instance spawned successfully.
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLldfCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26333336438343465', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333336438343465', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lazy-loading 'flavor' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:17 user nova-compute[74421]: INFO nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Took 5.90 seconds to spawn the instance on the hypervisor.
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:30:17 user nova-compute[74421]: INFO nova.compute.manager [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Took 6.97 seconds to build instance.
Oct 23 15:30:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9d10cee7-3c35-495b-aea4-89b0488bf5e7 tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 108003328 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 272629760 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "dcb2df43-8338-412d-b3f6-e506fea10603" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:19 user nova-compute[74421]: INFO nova.compute.manager [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Terminating instance
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-ed4109e0-248b-426a-884e-544a2a4c5126 req-4c7cc732-1c1e-4ec4-a2b5-0b17ea750a2c service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-vif-unplugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ed4109e0-248b-426a-884e-544a2a4c5126 req-4c7cc732-1c1e-4ec4-a2b5-0b17ea750a2c service nova] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ed4109e0-248b-426a-884e-544a2a4c5126 req-4c7cc732-1c1e-4ec4-a2b5-0b17ea750a2c service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ed4109e0-248b-426a-884e-544a2a4c5126 req-4c7cc732-1c1e-4ec4-a2b5-0b17ea750a2c service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-ed4109e0-248b-426a-884e-544a2a4c5126 req-4c7cc732-1c1e-4ec4-a2b5-0b17ea750a2c service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] No waiting events found dispatching network-vif-unplugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-ed4109e0-248b-426a-884e-544a2a4c5126 req-4c7cc732-1c1e-4ec4-a2b5-0b17ea750a2c service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-vif-unplugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Instance destroyed successfully.
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.objects.instance [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lazy-loading 'resources' on Instance uuid dcb2df43-8338-412d-b3f6-e506fea10603 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-243071967',display_name='tempest-VolumesActionsTest-instance-243071967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-243071967',id=19,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cfc1ff1ed441fe993ff3f5cf7606b1',ramdisk_id='',reservation_id='r-o5t63j10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-393084464',owner_user_name='tempest-VolumesActionsTest-393084464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:28:40Z,user_data=None,user_id='912eb1b1fd73437490d09a57a8d85831',uuid=dcb2df43-8338-412d-b3f6-e506fea10603,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converting VIF {"id": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "address": "fa:16:3e:66:65:37", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836eab32-4e", "ovs_interfaceid": "836eab32-4ed0-4fa3-bd1d-8f413a07eb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG os_vif [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap836eab32-4e, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ca54d18-37a8-4a6a-b3d9-8256350f5ee4) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:20 user nova-compute[74421]: INFO os_vif [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:65:37,bridge_name='br-int',has_traffic_filtering=True,id=836eab32-4ed0-4fa3-bd1d-8f413a07eb56,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836eab32-4e')
Oct 23 15:30:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Deleting instance files /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603_del
Oct 23 15:30:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Deletion of /opt/stack/data/nova/instances/dcb2df43-8338-412d-b3f6-e506fea10603_del complete
Oct 23 15:30:20 user nova-compute[74421]: INFO nova.compute.manager [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 23 15:30:20 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:30:20 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:30:20 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:30:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 772800512 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 936378368 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:21 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Took 1.05 seconds to deallocate network for instance.
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 1059061760 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] Acquiring lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] Lock "dcb2df43-8338-412d-b3f6-e506fea10603-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] No waiting events found dispatching network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:21 user nova-compute[74421]: WARNING nova.compute.manager [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received unexpected event network-vif-plugged-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 for instance with vm_state deleted and task_state None.
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-55d9ec8a-1db4-47c7-9181-a31abb53497e req-85b75e07-e09f-4c8f-8764-2903055150e9 service nova] [instance: dcb2df43-8338-412d-b3f6-e506fea10603] Received event network-vif-deleted-836eab32-4ed0-4fa3-bd1d-8f413a07eb56 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.666s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:21 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf7286-a63f-4294-a6c7-5e16bf4b4d58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:30:21 user nova-compute[74421]: No targets found.
Oct 23 15:30:21 user nova-compute[74421]: iSNS:
Oct 23 15:30:21 user nova-compute[74421]: No targets found.
Oct 23 15:30:21 user nova-compute[74421]: STATIC:
Oct 23 15:30:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:30:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:30:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c
Oct 23 15:30:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6
Oct 23 15:30:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:30:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:21 user nova-compute[74421]: FIRMWARE:
Oct 23 15:30:21 user nova-compute[74421]: No targets found.
Oct 23 15:30:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:30:21 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:30:21 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:30:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:30:21 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Deleted allocations for instance dcb2df43-8338-412d-b3f6-e506fea10603
Oct 23 15:30:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd2320-da09-4e5e-94fb-bd0b9a13872f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f75763d-fa4b-4486-a43e-42514c4b5de7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:22 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f248007fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1817b3b2-e2fa-4d09-b529-23143a3583b7 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "dcb2df43-8338-412d-b3f6-e506fea10603" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.928s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd197c0c-aa1a-4dd1-be10-7d57fa6d9654]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "0d259e70-884d-49c7-9a98-d318ecb01841" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb0f1b-7e24-4d54-a9ca-8157d4906c9f]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ed9e8-0381-492b-8ef5-4b1bfaf6a694]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[142ae498-4583-4585-bbfb-77b89af44edc]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc4f28-e5a1-48d6-aa10-6fcae056c3fe]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:30:22 user nova-compute[74421]: INFO nova.compute.claims [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Claim successful on node user
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f8301-4353-4de2-a093-864b9c81f9f3]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]
Oct 23 15:30:22 user nova-compute[74421]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b47eb8-3699-4afc-a69c-005a564e0847]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] <== disconnect_volume: return (450ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLldfCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb', 'attached_at': '', 'detached_at': '', 'volume_id': '61ca7893-0c16-4070-9af4-6a229614a64c', 'serial'} {{(pid=74421) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] swap_volume: removing Cinder connection for volume 6beb0bbd-b464-4303-b817-548429ed2ee6 {{(pid=74421) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:30:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.policy [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '166776dcccda43409673d99af45d4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733f39c7c95492abc827bd581ca7afa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:30:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Creating image(s)
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] swap_volume: Updating volume 6beb0bbd-b464-4303-b817-548429ed2ee6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GLldfCgy", "auth_password": "AFx7aOw1JfGRBc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "61ca7893-0c16-4070-9af4-6a229614a64c"}, "status": "reserved", "instance": "5ceb34be-c948-47d5-9efe-11c8e25a7ceb", "attached_at": "", "detached_at": "", "volume_id": "61ca7893-0c16-4070-9af4-6a229614a64c", "serial": "61ca7893-0c16-4070-9af4-6a229614a64c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '61ca7893-0c16-4070-9af4-6a229614a64c', 'no_device': None, 'attachment_id': '045f8910-37a1-4c50-b364-110cc9ab48dd'} {{(pid=74421) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ac67b46f-513a-4056-a827-82ac0977d017 tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 27.813s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk 1073741824" returned: 0 in 0.059s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:30:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Successfully created port: e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Cannot resize image /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Ensure instance console log exists: /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG os_brick.utils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7539be-7b9e-491a-ab07-10c15b831073]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67a6d9-d4f9-4f16-a74f-e5d94dbf9a7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dd64da-275d-414f-9adc-4d9fcba64418]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4699635-94d2-45fd-b387-006f181292a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:30:24 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe34b230-c5b3-4871-810f-eee973f4584f]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG os_brick.utils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Successfully updated port: e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-0d259e70-884d-49c7-9a98-d318ecb01841" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-0d259e70-884d-49c7-9a98-d318ecb01841" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-changed-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Refreshing instance network info cache due to event network-changed-e531b9fc-9d68-4e13-b9bb-028aaff81aba. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] Acquiring lock "refresh_cache-0d259e70-884d-49c7-9a98-d318ecb01841" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:30:24 user nova-compute[74421]: INFO nova.compute.manager [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Swapping volume 61ca7893-0c16-4070-9af4-6a229614a64c for 6beb0bbd-b464-4303-b817-548429ed2ee6
Oct 23 15:30:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Updating instance_info_cache with network_info: [{"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-0d259e70-884d-49c7-9a98-d318ecb01841" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Instance network_info: |[{"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] Acquired lock "refresh_cache-0d259e70-884d-49c7-9a98-d318ecb01841" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Refreshing network info cache for port e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Start _get_guest_xml network_info=[{"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:30:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1318179009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1318179009',id=26,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-o0gpmfw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:30:23Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=0d259e70-884d-49c7-9a98-d318ecb01841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d259e70-884d-49c7-9a98-d318ecb01841 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:30:25 user nova-compute[74421]:   <uuid>0d259e70-884d-49c7-9a98-d318ecb01841</uuid>
Oct 23 15:30:25 user nova-compute[74421]:   <name>instance-0000001a</name>
Oct 23 15:30:25 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:30:25 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:30:25 user nova-compute[74421]:   <metadata>
Oct 23 15:30:25 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:30:25 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:30:25 user nova-compute[74421]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1318179009</nova:name>
Oct 23 15:30:25 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:30:25</nova:creationTime>
Oct 23 15:30:25 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:30:25 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:30:25 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:30:25 user nova-compute[74421]:       <nova:owner>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:user uuid="166776dcccda43409673d99af45d4390">tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member</nova:user>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:project uuid="f733f39c7c95492abc827bd581ca7afa">tempest-ServerBootFromVolumeStableRescueTest-2014752681</nova:project>
Oct 23 15:30:25 user nova-compute[74421]:       </nova:owner>
Oct 23 15:30:25 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:30:25 user nova-compute[74421]:       <nova:ports>
Oct 23 15:30:25 user nova-compute[74421]:         <nova:port uuid="e531b9fc-9d68-4e13-b9bb-028aaff81aba">
Oct 23 15:30:25 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:30:25 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:25 user nova-compute[74421]:       </nova:ports>
Oct 23 15:30:25 user nova-compute[74421]:     </nova:instance>
Oct 23 15:30:25 user nova-compute[74421]:   </metadata>
Oct 23 15:30:25 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:30:25 user nova-compute[74421]:     <system>
Oct 23 15:30:25 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:30:25 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:30:25 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:30:25 user nova-compute[74421]:       <entry name="serial">0d259e70-884d-49c7-9a98-d318ecb01841</entry>
Oct 23 15:30:25 user nova-compute[74421]:       <entry name="uuid">0d259e70-884d-49c7-9a98-d318ecb01841</entry>
Oct 23 15:30:25 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:30:25 user nova-compute[74421]:     </system>
Oct 23 15:30:25 user nova-compute[74421]:   </sysinfo>
Oct 23 15:30:25 user nova-compute[74421]:   <os>
Oct 23 15:30:25 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:30:25 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:30:25 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:30:25 user nova-compute[74421]:   </os>
Oct 23 15:30:25 user nova-compute[74421]:   <features>
Oct 23 15:30:25 user nova-compute[74421]:     <acpi/>
Oct 23 15:30:25 user nova-compute[74421]:     <apic/>
Oct 23 15:30:25 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:30:25 user nova-compute[74421]:   </features>
Oct 23 15:30:25 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:30:25 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:30:25 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:30:25 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:30:25 user nova-compute[74421]:   </clock>
Oct 23 15:30:25 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:30:25 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:30:25 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:30:25 user nova-compute[74421]:   </cpu>
Oct 23 15:30:25 user nova-compute[74421]:   <devices>
Oct 23 15:30:25 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:30:25 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:30:25 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk"/>
Oct 23 15:30:25 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:30:25 user nova-compute[74421]:     </disk>
Oct 23 15:30:25 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:25 user nova-compute[74421]:       <mac address="fa:16:3e:95:33:19"/>
Oct 23 15:30:25 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:25 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:25 user nova-compute[74421]:       <target dev="tape531b9fc-9d"/>
Oct 23 15:30:25 user nova-compute[74421]:     </interface>
Oct 23 15:30:25 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:30:25 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/console.log" append="off"/>
Oct 23 15:30:25 user nova-compute[74421]:     </serial>
Oct 23 15:30:25 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:30:25 user nova-compute[74421]:     <video>
Oct 23 15:30:25 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:25 user nova-compute[74421]:     </video>
Oct 23 15:30:25 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:30:25 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:30:25 user nova-compute[74421]:     </rng>
Oct 23 15:30:25 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:30:25 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:30:25 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:30:25 user nova-compute[74421]:     </memballoon>
Oct 23 15:30:25 user nova-compute[74421]:   </devices>
Oct 23 15:30:25 user nova-compute[74421]: </domain>
Oct 23 15:30:25 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1318179009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1318179009',id=26,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-o0gpmfw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:30:23Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=0d259e70-884d-49c7-9a98-d318ecb01841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG os_vif [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc25bbdc-2948-57d6-9642-0dc99e649393', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape531b9fc-9d, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape531b9fc-9d, col_values=(('qos', UUID('065ac0db-520b-46e7-9eed-e4e663d3b770')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape531b9fc-9d, col_values=(('external_ids', {'iface-id': 'e531b9fc-9d68-4e13-b9bb-028aaff81aba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:33:19', 'vm-uuid': '0d259e70-884d-49c7-9a98-d318ecb01841'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:25 user nova-compute[74421]: INFO os_vif [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d')
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No VIF found with MAC fa:16:3e:95:33:19, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Updated VIF entry in instance network info cache for port e531b9fc-9d68-4e13-b9bb-028aaff81aba. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Updating instance_info_cache with network_info: [{"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ac1779ad-e6f6-4263-a8c9-6b1d9f601ef4 req-bb823543-7fb3-4c85-81ff-f19ed75bf8f7 service nova] Releasing lock "refresh_cache-0d259e70-884d-49c7-9a98-d318ecb01841" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-6233c145-7370-44c7-aba5-a38d9c5f90f6 req-059fdf9d-fecf-4e6b-9aed-49333feeca8b service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6233c145-7370-44c7-aba5-a38d9c5f90f6 req-059fdf9d-fecf-4e6b-9aed-49333feeca8b service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6233c145-7370-44c7-aba5-a38d9c5f90f6 req-059fdf9d-fecf-4e6b-9aed-49333feeca8b service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6233c145-7370-44c7-aba5-a38d9c5f90f6 req-059fdf9d-fecf-4e6b-9aed-49333feeca8b service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-6233c145-7370-44c7-aba5-a38d9c5f90f6 req-059fdf9d-fecf-4e6b-9aed-49333feeca8b service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:26 user nova-compute[74421]: WARNING nova.compute.manager [req-6233c145-7370-44c7-aba5-a38d9c5f90f6 req-059fdf9d-fecf-4e6b-9aed-49333feeca8b service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received unexpected event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with vm_state building and task_state spawning.
Oct 23 15:30:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-244a6ea0-138c-48aa-994f-9c8a1a485975 req-f83c569d-a94e-41ae-8656-da0c96d2b911 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-244a6ea0-138c-48aa-994f-9c8a1a485975 req-f83c569d-a94e-41ae-8656-da0c96d2b911 service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-244a6ea0-138c-48aa-994f-9c8a1a485975 req-f83c569d-a94e-41ae-8656-da0c96d2b911 service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-244a6ea0-138c-48aa-994f-9c8a1a485975 req-f83c569d-a94e-41ae-8656-da0c96d2b911 service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-244a6ea0-138c-48aa-994f-9c8a1a485975 req-f83c569d-a94e-41ae-8656-da0c96d2b911 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:29 user nova-compute[74421]: WARNING nova.compute.manager [req-244a6ea0-138c-48aa-994f-9c8a1a485975 req-f83c569d-a94e-41ae-8656-da0c96d2b911 service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received unexpected event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with vm_state building and task_state spawning.
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:30:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Instance spawned successfully.
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:29 user nova-compute[74421]: INFO nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Took 6.02 seconds to spawn the instance on the hypervisor.
Oct 23 15:30:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:30:29 user nova-compute[74421]: INFO nova.compute.manager [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Took 7.11 seconds to build instance.
Oct 23 15:30:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f7932a3b-7ca0-4578-a464-d3bc01ce321e tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "0d259e70-884d-49c7-9a98-d318ecb01841" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.259s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:30:30 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Creating image(s)
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Ensure instance console log exists: /opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Start _get_guest_xml network_info=[{"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '3473183c-82ef-4830-8f22-be5c79e79677', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbuTCBcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88cd91e1-d137-456b-8e26-cf3af34897e9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6', 'serial': 'a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6'}, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '47fcc8f1-924c-42d2-8783-7dce24ad720f', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FckQedyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88cd91e1-d137-456b-8e26-cf3af34897e9', 'attached_at': '', 'detached_at': '', 'volume_id': '4351761a-c02a-42ec-a35f-8172df04b9aa', 'serial': '4351761a-c02a-42ec-a35f-8172df04b9aa'}, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': 'e93a5589-5adc-4512-86fb-6bfdc6698fe2', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcYUuoXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88cd91e1-d137-456b-8e26-cf3af34897e9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6b803a2-7485-4f08-b5b7-f845312d5352', 'serial': 'a6b803a2-7485-4f08-b5b7-f845312d5352'}, 'boot_index': 2, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:30:30 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:30 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbuTCBcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:30 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:30 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:30 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6816853a-9360-4468-a09c-201b254d815a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:30:30 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7eac7-10a1-4da6-9156-20382b59b9a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6] added
Oct 23 15:30:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92ab78-1aa8-4a5e-84e1-f891af08d142]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2074894-8cff-4cd7-97f0-b6ac6c6931f1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbuTCBcA {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbuTCBcA" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b26063-b2dc-4efb-9cd4-784e1163c557]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbuTCBcA'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b726ad39-7881-4015-bb0f-e9718b6067f9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e58108-fe32-4e25-a0b6-8a7a055fb774]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[486e324e-c083-488e-854f-24908d5a4009]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260]
Oct 23 15:30:30 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8169af-1555-48b3-8d04-f1d0190dea7b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[584a420d-84ca-4c94-ba0f-064bc1239044]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:30 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3051a822-10f0-4d57-8267-e86783c0c3ed]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:30:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbuTCBcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26232653266376239', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232653266376239', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FckQedyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:31 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:31 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:31 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:30:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df30e0c8-eb75-4543-9ca9-9cea9d9cbd46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:30:31 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[db456368-01e8-4a97-8ecc-c4df1bef00ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa] added
Oct 23 15:30:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c059f00-42bf-4d53-9737-7708b3701e5d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed2af4e-4bdb-4aec-9ad4-37a9deb5777f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FckQedyp {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FckQedyp" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e5b00-0e9f-472f-8a21-f8846e6d0d4e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FckQedyp'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d678aa-1f87-42ab-a507-7b1a3935e8d5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eebdd4-4cfd-4955-a871-699b6738bba3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cb36c2-cbb7-4798-9cff-9ee543024f6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260]
Oct 23 15:30:32 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e424c1-5224-46da-849d-6086cfad2d15]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef960c2-c03f-4999-a990-597bce65291f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:32 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc31329-8f49-49c8-8105-ef33a2d4205f]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:30:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FckQedyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23439326663396663', 'path': '/dev/sdg'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439326663396663', 'path': '/dev/sdg'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcYUuoXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:33 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:33 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:33 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e81b03-ee38-41fb-b11a-2885105d9ac3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:30:33 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a83a57-4bf2-4a14-ba71-0983a6405bd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352] added
Oct 23 15:30:33 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed28e1-9135-4f56-8b5c-11f8e3be8baa]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b94708-79e1-4795-ba46-64b722779bd5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcYUuoXg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcYUuoXg" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa5d082-f5dd-4e82-a99e-ee6a647e2894]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TcYUuoXg'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d534c5ba-4c4f-426e-96e2-fecd11613566]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec6622-76fe-4ffc-bfd0-727f64b5649b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:33 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:33 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e570a9c-f5ee-44cc-bfa4-8995f22fb989]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260]
Oct 23 15:30:33 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:33 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba51dc13-49dd-4dd1-b243-8a41920778ce]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e843c-12e9-46ba-bb8d-7f16c4f1e0b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:33 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:33 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] HCTL ('39', '-', '-', 0) found on session 25 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4d630-9a9c-40c7-bd8e-ece848de9216]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Searching for a device in session 25 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:30:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcYUuoXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '26434643566373439', 'path': '/dev/sdh'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434643566373439', 'path': '/dev/sdh'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:34 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.objects.instance [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lazy-loading 'pci_devices' on Instance uuid 88cd91e1-d137-456b-8e26-cf3af34897e9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:30:35 user nova-compute[74421]:   <uuid>88cd91e1-d137-456b-8e26-cf3af34897e9</uuid>
Oct 23 15:30:35 user nova-compute[74421]:   <name>instance-00000017</name>
Oct 23 15:30:35 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:30:35 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:30:35 user nova-compute[74421]:   <metadata>
Oct 23 15:30:35 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:30:35 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:30:35 user nova-compute[74421]:       <nova:name>tempest-device-tagging-server-454683299</nova:name>
Oct 23 15:30:35 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:30:30</nova:creationTime>
Oct 23 15:30:35 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:30:35 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:30:35 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:30:35 user nova-compute[74421]:       <nova:owner>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:user uuid="f5300248ea78420c8cacd668de1f8932">tempest-TaggedBootDevicesTest_v242-797598540-project-member</nova:user>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:project uuid="c929d756f2f54ce4bceb88868166e598">tempest-TaggedBootDevicesTest_v242-797598540</nova:project>
Oct 23 15:30:35 user nova-compute[74421]:       </nova:owner>
Oct 23 15:30:35 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:30:35 user nova-compute[74421]:       <nova:ports>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="dd27138c-0c34-4091-a864-fb081149be7d">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="506ec095-0405-4a3f-aa55-b5b69ee1b40a">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.114" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="7e84e93c-a147-4453-ba0e-6109068ca0d9">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.184" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="f14032b2-c829-4282-b534-6fa8bee39902">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="df6223ec-5382-483f-b5ca-f3935d48f1f6">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="02c54509-9397-4304-af9f-57db3a519762">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:         <nova:port uuid="ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb">
Oct 23 15:30:35 user nova-compute[74421]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 15:30:35 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:35 user nova-compute[74421]:       </nova:ports>
Oct 23 15:30:35 user nova-compute[74421]:     </nova:instance>
Oct 23 15:30:35 user nova-compute[74421]:   </metadata>
Oct 23 15:30:35 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:30:35 user nova-compute[74421]:     <system>
Oct 23 15:30:35 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:30:35 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:30:35 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:30:35 user nova-compute[74421]:       <entry name="serial">88cd91e1-d137-456b-8e26-cf3af34897e9</entry>
Oct 23 15:30:35 user nova-compute[74421]:       <entry name="uuid">88cd91e1-d137-456b-8e26-cf3af34897e9</entry>
Oct 23 15:30:35 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:30:35 user nova-compute[74421]:     </system>
Oct 23 15:30:35 user nova-compute[74421]:   </sysinfo>
Oct 23 15:30:35 user nova-compute[74421]:   <os>
Oct 23 15:30:35 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:30:35 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:30:35 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:30:35 user nova-compute[74421]:   </os>
Oct 23 15:30:35 user nova-compute[74421]:   <features>
Oct 23 15:30:35 user nova-compute[74421]:     <acpi/>
Oct 23 15:30:35 user nova-compute[74421]:     <apic/>
Oct 23 15:30:35 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:30:35 user nova-compute[74421]:   </features>
Oct 23 15:30:35 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:30:35 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:30:35 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:30:35 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:30:35 user nova-compute[74421]:   </clock>
Oct 23 15:30:35 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:30:35 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:30:35 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:30:35 user nova-compute[74421]:   </cpu>
Oct 23 15:30:35 user nova-compute[74421]:   <devices>
Oct 23 15:30:35 user nova-compute[74421]:     <disk type="file" device="cdrom">
Oct 23 15:30:35 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 15:30:35 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9/disk.config"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="hda" bus="ide"/>
Oct 23 15:30:35 user nova-compute[74421]:     </disk>
Oct 23 15:30:35 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:30:35 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:35 user nova-compute[74421]:       <source dev="/dev/sdd"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <serial>a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6</serial>
Oct 23 15:30:35 user nova-compute[74421]:     </disk>
Oct 23 15:30:35 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:30:35 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:35 user nova-compute[74421]:       <source dev="/dev/sdg"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <serial>4351761a-c02a-42ec-a35f-8172df04b9aa</serial>
Oct 23 15:30:35 user nova-compute[74421]:     </disk>
Oct 23 15:30:35 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:30:35 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:35 user nova-compute[74421]:       <source dev="/dev/sdh"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="vdc" bus="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <serial>a6b803a2-7485-4f08-b5b7-f845312d5352</serial>
Oct 23 15:30:35 user nova-compute[74421]:     </disk>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:bb:c1:58"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tapdd27138c-0c"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:ea:f3:29"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tap506ec095-04"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:49:aa:96"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tap7e84e93c-a1"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:34:1d:d6"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tapf14032b2-c8"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:62:6f:73"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tapdf6223ec-53"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:a5:4c:e5"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tap02c54509-93"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:35 user nova-compute[74421]:       <mac address="fa:16:3e:7b:fa:b7"/>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:35 user nova-compute[74421]:       <target dev="tapebfd46d6-2e"/>
Oct 23 15:30:35 user nova-compute[74421]:     </interface>
Oct 23 15:30:35 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:30:35 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9/console.log" append="off"/>
Oct 23 15:30:35 user nova-compute[74421]:     </serial>
Oct 23 15:30:35 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:30:35 user nova-compute[74421]:     <video>
Oct 23 15:30:35 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:35 user nova-compute[74421]:     </video>
Oct 23 15:30:35 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:30:35 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:30:35 user nova-compute[74421]:     </rng>
Oct 23 15:30:35 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:30:35 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:30:35 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:30:35 user nova-compute[74421]:     </memballoon>
Oct 23 15:30:35 user nova-compute[74421]:   </devices>
Oct 23 15:30:35 user nova-compute[74421]: </domain>
Oct 23 15:30:35 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab2f0a44-535d-5412-8c55-820565cf6884', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd27138c-0c, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd27138c-0c, col_values=(('qos', UUID('e55e20f2-b762-4b21-975e-8202e5884fcc')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd27138c-0c, col_values=(('external_ids', {'iface-id': 'dd27138c-0c34-4091-a864-fb081149be7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:c1:58', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5f13029-29bd-5563-9e3c-a4a2ad34c5a7', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap506ec095-04, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap506ec095-04, col_values=(('qos', UUID('72d9a2d9-acf9-4248-81d8-88baba4767ef')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap506ec095-04, col_values=(('external_ids', {'iface-id': '506ec095-0405-4a3f-aa55-b5b69ee1b40a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:f3:29', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c35ea52-6686-5a2d-95c8-d5fceb0d4628', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e84e93c-a1, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e84e93c-a1, col_values=(('qos', UUID('21a113f3-b957-40fc-b7db-c365aea10f22')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e84e93c-a1, col_values=(('external_ids', {'iface-id': '7e84e93c-a147-4453-ba0e-6109068ca0d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:aa:96', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0aec7ca-1eae-51c7-be5d-5634338c5039', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf14032b2-c8, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf14032b2-c8, col_values=(('qos', UUID('e1e2fe17-f30d-449b-8f77-b1f8cfb01482')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf14032b2-c8, col_values=(('external_ids', {'iface-id': 'f14032b2-c829-4282-b534-6fa8bee39902', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:1d:d6', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43ddbeb1-f4f5-5ff6-825d-e73c462c8412', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf6223ec-53, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf6223ec-53, col_values=(('qos', UUID('d75a2352-af3e-4e9b-a2eb-857141cf71d6')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf6223ec-53, col_values=(('external_ids', {'iface-id': 'df6223ec-5382-483f-b5ca-f3935d48f1f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:6f:73', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d8342cb-e9dd-5177-a9f3-349ae1d3ae2c', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02c54509-93, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02c54509-93, col_values=(('qos', UUID('80d99afa-e8b3-45c9-b21d-057699bf994e')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02c54509-93, col_values=(('external_ids', {'iface-id': '02c54509-9397-4304-af9f-57db3a519762', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:4c:e5', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47c20516-bd7f-56f7-8515-752787ebc78d', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebfd46d6-2e, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebfd46d6-2e, col_values=(('qos', UUID('11ee5bae-00c6-44ee-8d65-5f5cf4f266bc')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebfd46d6-2e, col_values=(('external_ids', {'iface-id': 'ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:fa:b7', 'vm-uuid': '88cd91e1-d137-456b-8e26-cf3af34897e9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:35 user nova-compute[74421]: INFO os_vif [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e')
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] No BDM found with device name hda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] No VIF found with MAC fa:16:3e:bb:c1:58, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:30:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] No VIF found with MAC fa:16:3e:62:6f:73, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:30:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Using config drive
Oct 23 15:30:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Creating config drive at /opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9/disk.config
Oct 23 15:30:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps41vubj_ {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps41vubj_" returned: 0 in 0.063s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:30:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-372b9a24-8a34-460d-a3ba-81cd96962c32 req-c74545a6-e4ac-4276-9ae6-c48ec36a610a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-372b9a24-8a34-460d-a3ba-81cd96962c32 req-c74545a6-e4ac-4276-9ae6-c48ec36a610a service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-372b9a24-8a34-460d-a3ba-81cd96962c32 req-c74545a6-e4ac-4276-9ae6-c48ec36a610a service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-372b9a24-8a34-460d-a3ba-81cd96962c32 req-c74545a6-e4ac-4276-9ae6-c48ec36a610a service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-372b9a24-8a34-460d-a3ba-81cd96962c32 req-c74545a6-e4ac-4276-9ae6-c48ec36a610a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:38 user nova-compute[74421]: WARNING nova.compute.manager [req-372b9a24-8a34-460d-a3ba-81cd96962c32 req-c74545a6-e4ac-4276-9ae6-c48ec36a610a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d for instance with vm_state building and task_state spawning.
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-04835234-662b-47a6-aef0-77dc051d9a9a req-dd0f43e9-bef6-4a52-b089-56fc52b99b68 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-04835234-662b-47a6-aef0-77dc051d9a9a req-dd0f43e9-bef6-4a52-b089-56fc52b99b68 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-04835234-662b-47a6-aef0-77dc051d9a9a req-dd0f43e9-bef6-4a52-b089-56fc52b99b68 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-04835234-662b-47a6-aef0-77dc051d9a9a req-dd0f43e9-bef6-4a52-b089-56fc52b99b68 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-04835234-662b-47a6-aef0-77dc051d9a9a req-dd0f43e9-bef6-4a52-b089-56fc52b99b68 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:39 user nova-compute[74421]: WARNING nova.compute.manager [req-04835234-662b-47a6-aef0-77dc051d9a9a req-dd0f43e9-bef6-4a52-b089-56fc52b99b68 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 for instance with vm_state building and task_state spawning.
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-d44c1e36-a1cc-4a23-b81f-f14f7f03e62d req-3e517992-fa6b-43b5-9aad-ed109d48c950 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d44c1e36-a1cc-4a23-b81f-f14f7f03e62d req-3e517992-fa6b-43b5-9aad-ed109d48c950 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d44c1e36-a1cc-4a23-b81f-f14f7f03e62d req-3e517992-fa6b-43b5-9aad-ed109d48c950 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d44c1e36-a1cc-4a23-b81f-f14f7f03e62d req-3e517992-fa6b-43b5-9aad-ed109d48c950 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-d44c1e36-a1cc-4a23-b81f-f14f7f03e62d req-3e517992-fa6b-43b5-9aad-ed109d48c950 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:39 user nova-compute[74421]: WARNING nova.compute.manager [req-d44c1e36-a1cc-4a23-b81f-f14f7f03e62d req-3e517992-fa6b-43b5-9aad-ed109d48c950 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 for instance with vm_state building and task_state spawning.
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: INFO nova.compute.manager [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Rescuing
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:40 user nova-compute[74421]: WARNING nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d for instance with vm_state building and task_state spawning.
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:40 user nova-compute[74421]: WARNING nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a for instance with vm_state building and task_state spawning.
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:40 user nova-compute[74421]: WARNING nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a for instance with vm_state building and task_state spawning.
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:40 user nova-compute[74421]: WARNING nova.compute.manager [req-82441da7-f74a-4f16-82c1-9a06c7679dfb req-99b3ce37-9128-419e-8d39-326e89903655 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 for instance with vm_state building and task_state spawning.
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:41 user nova-compute[74421]: WARNING nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 for instance with vm_state building and task_state spawning.
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:41 user nova-compute[74421]: WARNING nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb for instance with vm_state building and task_state spawning.
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:41 user nova-compute[74421]: WARNING nova.compute.manager [req-48519a0d-04e6-4b8c-9ff4-7397007b004d req-26667164-4ad8-4b18-a74e-ef59ca60ae78 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb for instance with vm_state building and task_state spawning.
Oct 23 15:30:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:41 user nova-compute[74421]: WARNING nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 for instance with vm_state building and task_state spawning.
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:41 user nova-compute[74421]: WARNING nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 for instance with vm_state building and task_state spawning.
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:41 user nova-compute[74421]: WARNING nova.compute.manager [req-2f102afb-855f-41ca-9288-0475a70c32c3 req-8c489555-8a9e-4066-83ae-2e19d09820ba service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 for instance with vm_state building and task_state spawning.
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:30:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance destroyed successfully.
Oct 23 15:30:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Attempting rescue
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74421) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:30:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Creating image(s)
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'trusted_certs' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.235s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue" returned: 0 in 0.061s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'migration_context' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<19b0c20d-3f1a-4897-852a-9fb248f5d5f7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Start _get_guest_xml network_info=[{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:ab:4d:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'resources' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<19b0c20d-3f1a-4897-852a-9fb248f5d5f7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'numa_topology' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<19b0c20d-3f1a-4897-852a-9fb248f5d5f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:30:42 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:42 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'vcpu_model' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<19b0c20d-3f1a-4897-852a-9fb248f5d5f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-659659007',display_name='tempest-ServerRescueNegativeTestJSON-server-659659007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-659659007',id=21,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-2s0cbhg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:01Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=19b0c20d-3f1a-4897-852a-9fb248f5d5f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:ab:4d:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:ab:4d:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'pci_devices' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<19b0c20d-3f1a-4897-852a-9fb248f5d5f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:30:42 user nova-compute[74421]:   <uuid>19b0c20d-3f1a-4897-852a-9fb248f5d5f7</uuid>
Oct 23 15:30:42 user nova-compute[74421]:   <name>instance-00000015</name>
Oct 23 15:30:42 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:30:42 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:30:42 user nova-compute[74421]:   <metadata>
Oct 23 15:30:42 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:30:42 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:30:42 user nova-compute[74421]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-659659007</nova:name>
Oct 23 15:30:42 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:30:42</nova:creationTime>
Oct 23 15:30:42 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:30:42 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:30:42 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:30:42 user nova-compute[74421]:       <nova:owner>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:user uuid="6b5629aa90fa4b40b4886cb46dc21e65">tempest-ServerRescueNegativeTestJSON-1858635885-project-member</nova:user>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:project uuid="db8ed209b95549e8a0d77ead103b1c1a">tempest-ServerRescueNegativeTestJSON-1858635885</nova:project>
Oct 23 15:30:42 user nova-compute[74421]:       </nova:owner>
Oct 23 15:30:42 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:30:42 user nova-compute[74421]:       <nova:ports>
Oct 23 15:30:42 user nova-compute[74421]:         <nova:port uuid="0274fe50-08cc-4f3f-aca6-ec69220dfbfc">
Oct 23 15:30:42 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 15:30:42 user nova-compute[74421]:         </nova:port>
Oct 23 15:30:42 user nova-compute[74421]:       </nova:ports>
Oct 23 15:30:42 user nova-compute[74421]:     </nova:instance>
Oct 23 15:30:42 user nova-compute[74421]:   </metadata>
Oct 23 15:30:42 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:30:42 user nova-compute[74421]:     <system>
Oct 23 15:30:42 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:30:42 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:30:42 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:30:42 user nova-compute[74421]:       <entry name="serial">19b0c20d-3f1a-4897-852a-9fb248f5d5f7</entry>
Oct 23 15:30:42 user nova-compute[74421]:       <entry name="uuid">19b0c20d-3f1a-4897-852a-9fb248f5d5f7</entry>
Oct 23 15:30:42 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:30:42 user nova-compute[74421]:     </system>
Oct 23 15:30:42 user nova-compute[74421]:   </sysinfo>
Oct 23 15:30:42 user nova-compute[74421]:   <os>
Oct 23 15:30:42 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:30:42 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:30:42 user nova-compute[74421]:   </os>
Oct 23 15:30:42 user nova-compute[74421]:   <features>
Oct 23 15:30:42 user nova-compute[74421]:     <acpi/>
Oct 23 15:30:42 user nova-compute[74421]:     <apic/>
Oct 23 15:30:42 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:30:42 user nova-compute[74421]:   </features>
Oct 23 15:30:42 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:30:42 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:30:42 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:30:42 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:30:42 user nova-compute[74421]:   </clock>
Oct 23 15:30:42 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:30:42 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:30:42 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:30:42 user nova-compute[74421]:   </cpu>
Oct 23 15:30:42 user nova-compute[74421]:   <devices>
Oct 23 15:30:42 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:30:42 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:30:42 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue"/>
Oct 23 15:30:42 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:30:42 user nova-compute[74421]:     </disk>
Oct 23 15:30:42 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:30:42 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:30:42 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk"/>
Oct 23 15:30:42 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:30:42 user nova-compute[74421]:     </disk>
Oct 23 15:30:42 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:30:42 user nova-compute[74421]:       <mac address="fa:16:3e:ab:4d:45"/>
Oct 23 15:30:42 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:42 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:30:42 user nova-compute[74421]:       <target dev="tap0274fe50-08"/>
Oct 23 15:30:42 user nova-compute[74421]:     </interface>
Oct 23 15:30:42 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:30:42 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/console.log" append="off"/>
Oct 23 15:30:42 user nova-compute[74421]:     </serial>
Oct 23 15:30:42 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:30:42 user nova-compute[74421]:     <video>
Oct 23 15:30:42 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:30:42 user nova-compute[74421]:     </video>
Oct 23 15:30:42 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:30:42 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:30:42 user nova-compute[74421]:     </rng>
Oct 23 15:30:42 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:30:42 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:30:42 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:30:42 user nova-compute[74421]:     </memballoon>
Oct 23 15:30:42 user nova-compute[74421]:   </devices>
Oct 23 15:30:42 user nova-compute[74421]: </domain>
Oct 23 15:30:42 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:30:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance destroyed successfully.
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:ab:4d:45, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-613b553f-db33-48bf-ab68-d904d8080435 req-9866f85f-3f3e-43d7-9868-73958e065c8a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-613b553f-db33-48bf-ab68-d904d8080435 req-9866f85f-3f3e-43d7-9868-73958e065c8a service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-613b553f-db33-48bf-ab68-d904d8080435 req-9866f85f-3f3e-43d7-9868-73958e065c8a service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-613b553f-db33-48bf-ab68-d904d8080435 req-9866f85f-3f3e-43d7-9868-73958e065c8a service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-613b553f-db33-48bf-ab68-d904d8080435 req-9866f85f-3f3e-43d7-9868-73958e065c8a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:42 user nova-compute[74421]: WARNING nova.compute.manager [req-613b553f-db33-48bf-ab68-d904d8080435 req-9866f85f-3f3e-43d7-9868-73958e065c8a service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 for instance with vm_state building and task_state spawning.
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:30:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance spawned successfully.
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.compute.manager [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-unplugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.compute.manager [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-unplugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:43 user nova-compute[74421]: WARNING nova.compute.manager [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-unplugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state active and task_state rescuing.
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.compute.manager [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.compute.manager [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:43 user nova-compute[74421]: WARNING nova.compute.manager [req-87ce79ee-8503-4f27-aa4b-8d03568f5a69 req-e62f7bee-e6b1-4bfa-b49f-7d737490f09d service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state active and task_state rescuing.
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:43 user nova-compute[74421]: INFO nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Took 12.80 seconds to spawn the instance on the hypervisor.
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:43 user nova-compute[74421]: INFO nova.compute.manager [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Took 74.74 seconds to build instance.
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-40e7d2dd-d77c-42f3-a2d8-63d6bfa73037 tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 74.852s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:43 user nova-compute[74421]: INFO nova.compute.manager [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Terminating instance
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Instance destroyed successfully.
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.objects.instance [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lazy-loading 'resources' on Instance uuid 110e0389-5c67-43c8-adff-dc9af9eff34e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-827624569',display_name='tempest-ServersNegativeTestJSON-server-827624569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-827624569',id=1,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:21:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab1b4d9c12e94c4fa438af397abcff40',ramdisk_id='',reservation_id='r-3ud7q00r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-297395355',owner_user_name='tempest-ServersNegativeTestJSON-297395355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:21:49Z,user_data=None,user_id='4ecc4a733599474d926e8feeda4e9328',uuid=110e0389-5c67-43c8-adff-dc9af9eff34e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converting VIF {"id": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "address": "fa:16:3e:21:bd:1b", "network": {"id": "44aaeeb6-29a3-44b1-aec0-806fcd32f324", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1677842409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab1b4d9c12e94c4fa438af397abcff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa2172c-6b", "ovs_interfaceid": "3fa2172c-6b73-463e-9ac6-b680d5ba69e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG os_vif [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fa2172c-6b, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b78984df-139f-4277-9978-2988a2ef1378) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:44 user nova-compute[74421]: INFO os_vif [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:bd:1b,bridge_name='br-int',has_traffic_filtering=True,id=3fa2172c-6b73-463e-9ac6-b680d5ba69e1,network=Network(44aaeeb6-29a3-44b1-aec0-806fcd32f324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa2172c-6b')
Oct 23 15:30:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Deleting instance files /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e_del
Oct 23 15:30:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Deletion of /opt/stack/data/nova/instances/110e0389-5c67-43c8-adff-dc9af9eff34e_del complete
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:44 user nova-compute[74421]: INFO nova.compute.manager [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:45 user nova-compute[74421]: WARNING nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state active and task_state rescuing.
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:45 user nova-compute[74421]: WARNING nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state active and task_state rescuing.
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-vif-unplugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] No waiting events found dispatching network-vif-unplugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-vif-unplugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Acquiring lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] No waiting events found dispatching network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:45 user nova-compute[74421]: WARNING nova.compute.manager [req-f0e68fdd-dda1-4b99-a1f1-6c3b56151151 req-708778f0-4298-45b6-813f-585cd9e8c26a service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received unexpected event network-vif-plugged-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 for instance with vm_state active and task_state deleting.
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received event network-changed-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Refreshing instance network info cache due to event network-changed-4546894b-2ab7-41ef-82bd-05848f7ebd23. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] Acquiring lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] Acquired lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Refreshing network info cache for port 4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:45 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Took 0.72 seconds to deallocate network for instance.
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updated VIF entry in instance network info cache for port 4546894b-2ab7-41ef-82bd-05848f7ebd23. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updating instance_info_cache with network_info: [{"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f29963d-af9b-4b49-952d-7b6d7c193391 req-e3059699-7290-470f-b2ba-65761335794f service nova] Releasing lock "refresh_cache-c436795b-5a83-48e8-a98c-53dbe8c28363" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb', 'attached_at': '', 'detached_at': '', 'volume_id': '6beb0bbd-b464-4303-b817-548429ed2ee6', 'serial': '6beb0bbd-b464-4303-b817-548429ed2ee6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLldfCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '61ca7893-0c16-4070-9af4-6a229614a64c'}, 'status': 'reserved', 'instance': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb', 'attached_at': '', 'detached_at': '', 'volume_id': '61ca7893-0c16-4070-9af4-6a229614a64c', 'serial'} {{(pid=74421) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:46 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:46 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:46 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.725s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b1c68-14de-47f5-bd9c-ff5dfe0a810e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:30:46 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa4fe57-52c7-461f-9f8f-0b10c1b7fdca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6] added
Oct 23 15:30:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Deleted allocations for instance 110e0389-5c67-43c8-adff-dc9af9eff34e
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e4d040-0dca-4c22-a844-bef369f2b2e6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7339f-d861-4cc1-bbd1-f33b59b0ef02]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTFKMlat {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTFKMlat" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee24e3-76dd-45ac-8c14-f2fb8a64178d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTFKMlat'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-844e193d-0302-446a-8f0b-ee0174d00202 tempest-ServersNegativeTestJSON-297395355 tempest-ServersNegativeTestJSON-297395355-project-member] Lock "110e0389-5c67-43c8-adff-dc9af9eff34e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d95460b-dbb4-4587-967d-972f0ba96786]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e6247-0d8e-4cfc-8312-0576664c0520]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f36c7-d20b-4720-90ce-0a209dd4c673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]
Oct 23 15:30:46 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-95d96945-cbd4-4a36-acf6-79762fc86225 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e757338-28c3-45ad-9116-a55a1880d095]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa49868-6202-4f97-b83f-218c8c5affa0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] HCTL ('40', '-', '-', 0) found on session 26 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[765bac8e-f495-4867-93ab-51df0aea10d5]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Searching for a device in session 26 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b603c88-6dfb-417d-a3c9-ad79a2830c7f req-2be6384a-bfbf-4717-a70c-57e173b093e6 service nova] [instance: 110e0389-5c67-43c8-adff-dc9af9eff34e] Received event network-vif-deleted-3fa2172c-6b73-463e-9ac6-b680d5ba69e1 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:30:47 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '110e0389-5c67-43c8-adff-dc9af9eff34e' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '110e0389-5c67-43c8-adff-dc9af9eff34e' (instance-00000001)
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '26631373462353962', 'path': '/dev/sdi'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631373462353962', 'path': '/dev/sdi'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lazy-loading 'flavor' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:49 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:49 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=6802MB free_disk=25.117935180664062GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 288358400 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef24f4fa-32df-438e-bb56-ee4a0b32770c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance c436795b-5a83-48e8-a98c-53dbe8c28363 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 88cd91e1-d137-456b-8e26-cf3af34897e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 980791bd-c51d-4cf5-b72b-dd2262fc1f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance db43eba9-ae25-4e37-8554-39d67abe06b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 438304768 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:50 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:50 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:30:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.886s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 593494016 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 861929472 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid c436795b-5a83-48e8-a98c-53dbe8c28363 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 1006632960 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:52 user nova-compute[74421]: INFO nova.compute.manager [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Attaching volume 19ea07a7-9b61-464e-86f9-3705436c5c85 to /dev/vdb
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c90872-cc82-420e-a86b-5e1796ea0c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4687e1b-1261-4f16-b91e-a4b6eb1f7e20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75865d0-6cdf-49bf-8d03-75d06dab25a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d47274-1a3b-4d16-9882-9b0b833f9c6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:30:52 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ce06f6-f5f1-438d-8bc1-440c7474786e]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updating existing volume attachment record: 6fa63cd4-56ed-413d-8764-d8edc363ff98 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLldfCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '61ca7893-0c16-4070-9af4-6a229614a64c'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:52 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d40291-20a1-4fd6-91ca-84824f30b231]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:30:52 user nova-compute[74421]: No targets found.
Oct 23 15:30:52 user nova-compute[74421]: iSNS:
Oct 23 15:30:52 user nova-compute[74421]: No targets found.
Oct 23 15:30:52 user nova-compute[74421]: STATIC:
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:30:52 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:52 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:52 user nova-compute[74421]: FIRMWARE:
Oct 23 15:30:52 user nova-compute[74421]: No targets found.
Oct 23 15:30:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:30:52 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:30:52 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b3fa9d-fcaf-4305-9343-64ba57c37328]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb4133d-1321-4f9e-9498-b765552402fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:52 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f248007df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c'): ({'sdf'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Removing single pathed devices sdf {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[273c9320-4f10-442a-88a4-3b3838702cdc]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a58c22-0892-4c13-990b-c23b35df024e]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Flushing IO for device /dev/sdf {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a732ad54-c6ae-4ed0-9594-b861c6069c1c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a8f3b-4a44-4af8-9fef-b220b475c4a6]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[985e4bcf-d6a2-4f21-9c27-f0fe805000ce]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef542c8e-c524-40e3-966b-941342b67bab]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260]
Oct 23 15:30:53 user nova-compute[74421]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:53 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ca7893-0c16-4070-9af4-6a229614a64c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[70344c9a-b7d6-49db-bad0-bf04d144257a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] <== disconnect_volume: return (390ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '5ceb34be-c948-47d5-9efe-11c8e25a7ceb', 'attached_at': '', 'detached_at': '', 'volume_id': '6beb0bbd-b464-4303-b817-548429ed2ee6', 'serial'} {{(pid=74421) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 15:30:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] swap_volume: removing Cinder connection for volume 61ca7893-0c16-4070-9af4-6a229614a64c {{(pid=74421) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] swap_volume: Updating volume 61ca7893-0c16-4070-9af4-6a229614a64c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BTFKMlat", "auth_password": "nrpX0wviAg2Yqo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "6beb0bbd-b464-4303-b817-548429ed2ee6"}, "status": "reserved", "instance": "5ceb34be-c948-47d5-9efe-11c8e25a7ceb", "attached_at": "", "detached_at": "", "volume_id": "6beb0bbd-b464-4303-b817-548429ed2ee6", "serial": "6beb0bbd-b464-4303-b817-548429ed2ee6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6beb0bbd-b464-4303-b817-548429ed2ee6', 'no_device': None, 'attachment_id': 'f2d9925b-54b1-4ccb-9e6b-f45a7cd8aa55'} {{(pid=74421) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c3dca403-2a05-4ca5-9897-bd06f96876ee tempest-TestVolumeSwap-49227602 tempest-TestVolumeSwap-49227602-project-admin] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 29.478s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:54 user nova-compute[74421]: INFO nova.compute.manager [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Terminating instance
Oct 23 15:30:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-0eeac5e3-8aba-46c2-9b59-ec46d70b79c4 req-7d24d244-296c-4db0-87b7-fac179677432 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0eeac5e3-8aba-46c2-9b59-ec46d70b79c4 req-7d24d244-296c-4db0-87b7-fac179677432 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0eeac5e3-8aba-46c2-9b59-ec46d70b79c4 req-7d24d244-296c-4db0-87b7-fac179677432 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0eeac5e3-8aba-46c2-9b59-ec46d70b79c4 req-7d24d244-296c-4db0-87b7-fac179677432 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-0eeac5e3-8aba-46c2-9b59-ec46d70b79c4 req-7d24d244-296c-4db0-87b7-fac179677432 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-0eeac5e3-8aba-46c2-9b59-ec46d70b79c4 req-7d24d244-296c-4db0-87b7-fac179677432 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-unplugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Instance destroyed successfully.
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lazy-loading 'resources' on Instance uuid ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-652792039',display_name='tempest-ServerActionsTestOtherB-server-652792039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-652792039',id=6,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESaWwvjP7M+qwFrb0WScO0Ef5dIpmYq2CLcwUhYwCeNDAkAN00nBqcxUk6PBn7N5BP3uIN3qGxn/ZndaFhRuvR5OTAIVIWpxW5szrRZ9SETBUK3GUUYbGQctJxJ02YSfw==',key_name='tempest-keypair-377564042',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fd7efc2de094cc6b45ebe7e14aceecb',ramdisk_id='',reservation_id='r-0t031f8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-919492088',owner_user_name='tempest-ServerActionsTestOtherB-919492088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce501ef5d45c43efa6fd1329bd1b417d',uuid=ee5687a0-6e1a-4ce6-954a-d6959b2c8c12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converting VIF {"id": "7dd217a3-a501-4e28-a7f6-659356f41eca", "address": "fa:16:3e:c9:79:7e", "network": {"id": "e83015e4-c2ea-407c-818a-1665099ad2fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-415882738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fd7efc2de094cc6b45ebe7e14aceecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd217a3-a5", "ovs_interfaceid": "7dd217a3-a501-4e28-a7f6-659356f41eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_vif [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dd217a3-a5, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71dd2994-2bb1-40f8-b834-1a2c9b0b84a9) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:55 user nova-compute[74421]: INFO os_vif [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=7dd217a3-a501-4e28-a7f6-659356f41eca,network=Network(e83015e4-c2ea-407c-818a-1665099ad2fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd217a3-a5')
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYJqGDtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:30:55 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df1ba6-1e31-4301-b6a2-2b02ab3d6437]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:30:55 user nova-compute[74421]: No targets found.
Oct 23 15:30:55 user nova-compute[74421]: iSNS:
Oct 23 15:30:55 user nova-compute[74421]: No targets found.
Oct 23 15:30:55 user nova-compute[74421]: STATIC:
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9
Oct 23 15:30:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:30:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:30:55 user nova-compute[74421]: FIRMWARE:
Oct 23 15:30:55 user nova-compute[74421]: No targets found.
Oct 23 15:30:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:30:55 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:30:55 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195e58e-6db0-4a03-9715-c42e40d4b4fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddbc75b-396b-49bf-a695-28f641a808d3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:30:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478306b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd2ab45-03fb-4355-917e-e67d5b81c960]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fabe9-71d6-443f-ae6d-6b315428557c]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.compute.manager [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Detaching volume 6beb0bbd-b464-4303-b817-548429ed2ee6
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d7906f-dfb2-4c08-b1de-2a8dc7cd3f4f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[22452398-383b-487f-b7b6-4e0607b056f4]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ad8e7-3732-410b-937b-ea229f4e29b4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.virt.block_device [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Attempting to driver detach volume 6beb0bbd-b464-4303-b817-548429ed2ee6 from mountpoint /dev/vdb
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Attempting to detach device vdb from instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:30:55 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:55 user nova-compute[74421]:   <source dev="/dev/sdi"/>
Oct 23 15:30:55 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:30:55 user nova-compute[74421]:   <serial>6beb0bbd-b464-4303-b817-548429ed2ee6</serial>
Oct 23 15:30:55 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:30:55 user nova-compute[74421]: </disk>
Oct 23 15:30:55 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Successfully detached device vdb from instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb from the persistent domain config.
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:30:55 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:55 user nova-compute[74421]:   <source dev="/dev/sdi"/>
Oct 23 15:30:55 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:30:55 user nova-compute[74421]:   <serial>6beb0bbd-b464-4303-b817-548429ed2ee6</serial>
Oct 23 15:30:55 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:30:55 user nova-compute[74421]: </disk>
Oct 23 15:30:55 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[47735275-5f34-4d55-a75a-71e9923a5cc3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260]
Oct 23 15:30:55 user nova-compute[74421]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9, portal: 172.16.0.220,3260] successful.
Oct 23 15:30:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b86caa5-8282-4d91-8d51-b75cdd1bc9a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f88d11a-c5a4-4983-926f-e43f79d539a7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] <== disconnect_volume: return (391ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Deleting instance files /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12_del
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Deletion of /opt/stack/data/nova/instances/ee5687a0-6e1a-4ce6-954a-d6959b2c8c12_del complete
Oct 23 15:30:55 user nova-compute[74421]: INFO nova.compute.manager [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 23 15:30:55 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:30:55 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:30:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-d93ab0eb-a421-4a2d-ad90-37ce0ef343d9 req-135da599-a759-4898-91a0-24398dd928c2 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-deleted-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:57 user nova-compute[74421]: INFO nova.compute.manager [req-d93ab0eb-a421-4a2d-ad90-37ce0ef343d9 req-135da599-a759-4898-91a0-24398dd928c2 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Neutron deleted interface 7dd217a3-a501-4e28-a7f6-659356f41eca; detaching it from the instance and deleting it from the info cache
Oct 23 15:30:57 user nova-compute[74421]: DEBUG nova.network.neutron [req-d93ab0eb-a421-4a2d-ad90-37ce0ef343d9 req-135da599-a759-4898-91a0-24398dd928c2 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:30:57 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Took 1.12 seconds to deallocate network for instance.
Oct 23 15:30:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-d93ab0eb-a421-4a2d-ad90-37ce0ef343d9 req-135da599-a759-4898-91a0-24398dd928c2 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Detach interface failed, port_id=7dd217a3-a501-4e28-a7f6-659356f41eca, reason: Instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-8cb54d4b-d6c2-4144-997b-14dc603f2ef9 req-17e2f971-bbd5-4312-b6fa-9889189e4e69 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cb54d4b-d6c2-4144-997b-14dc603f2ef9 req-17e2f971-bbd5-4312-b6fa-9889189e4e69 service nova] Acquiring lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cb54d4b-d6c2-4144-997b-14dc603f2ef9 req-17e2f971-bbd5-4312-b6fa-9889189e4e69 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8cb54d4b-d6c2-4144-997b-14dc603f2ef9 req-17e2f971-bbd5-4312-b6fa-9889189e4e69 service nova] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-8cb54d4b-d6c2-4144-997b-14dc603f2ef9 req-17e2f971-bbd5-4312-b6fa-9889189e4e69 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] No waiting events found dispatching network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:30:57 user nova-compute[74421]: WARNING nova.compute.manager [req-8cb54d4b-d6c2-4144-997b-14dc603f2ef9 req-17e2f971-bbd5-4312-b6fa-9889189e4e69 service nova] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Received unexpected event network-vif-plugged-7dd217a3-a501-4e28-a7f6-659356f41eca for instance with vm_state active and task_state deleting.
Oct 23 15:30:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:30:58 user nova-compute[74421]: INFO nova.compute.manager [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] [instance: ee5687a0-6e1a-4ce6-954a-d6959b2c8c12] Took 0.92 seconds to detach 1 volumes for instance.
Oct 23 15:30:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:58 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:30:58 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:30:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:58 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Deleted allocations for instance ee5687a0-6e1a-4ce6-954a-d6959b2c8c12
Oct 23 15:30:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d6f4fd41-4e34-49f1-9ea5-db5ad0172a53 tempest-ServerActionsTestOtherB-919492088 tempest-ServerActionsTestOtherB-919492088-project-member] Lock "ee5687a0-6e1a-4ce6-954a-d6959b2c8c12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.117s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:30:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:30:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:30:59 user nova-compute[74421]: INFO nova.compute.manager [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Detaching volume 60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:30:59 user nova-compute[74421]: INFO nova.virt.block_device [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Attempting to driver detach volume 60bbdf62-e2ca-4d93-98f0-71b544193882 from mountpoint /dev/vdb
Oct 23 15:30:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Attempting to detach device vdb from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:30:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:30:59 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:59 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:30:59 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:30:59 user nova-compute[74421]:   <serial>60bbdf62-e2ca-4d93-98f0-71b544193882</serial>
Oct 23 15:30:59 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 15:30:59 user nova-compute[74421]: </disk>
Oct 23 15:30:59 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:30:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully detached device vdb from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 from the persistent domain config.
Oct 23 15:30:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:30:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:30:59 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:30:59 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:30:59 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:30:59 user nova-compute[74421]:   <serial>60bbdf62-e2ca-4d93-98f0-71b544193882</serial>
Oct 23 15:30:59 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 15:30:59 user nova-compute[74421]: </disk>
Oct 23 15:30:59 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:30:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:31:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:10 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:31:10 user nova-compute[74421]: INFO nova.compute.claims [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Claim successful on node user
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:31:11 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykYLCmgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:31:11 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:31:11 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:31:11 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.policy [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '912eb1b1fd73437490d09a57a8d85831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cfc1ff1ed441fe993ff3f5cf7606b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576c281-bb65-4b9c-9dac-8b5a6d063db4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:31:11 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69d61a-b3ef-46ff-83ef-df1f286d6aea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85] added
Oct 23 15:31:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69854b6-dd22-4e4f-b6de-b13795c8df60]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a626a3a-5296-4545-b469-146d4431bbc6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykYLCmgd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:31:11 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Creating image(s)
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "/opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "/opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "/opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykYLCmgd" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f799ab6-432d-4516-ab1b-3384d31a408b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykYLCmgd'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3cecc5-5f6c-41af-a9cd-394bba39d465]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b825e2-9612-4a4b-8f47-7da3c6e9cc26]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c731079-e963-4b33-8b84-37cf48fec97c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260]
Oct 23 15:31:11 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260] successful.
Oct 23 15:31:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e479261f-f420-4a9c-9460-f2b8674f9785]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab633175-ce5c-4676-92da-6e0f055d51a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:11 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa29aa-d9e7-4fe3-be55-20a32dcdca74]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:31:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykYLCmgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk 1073741824" returned: 0 in 0.058s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Successfully created port: 758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Cannot resize image /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Ensure instance console log exists: /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23035663839633737', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:31:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035663839633737', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid c436795b-5a83-48e8-a98c-53dbe8c28363 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:31:13 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:31:13 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:31:13 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:31:13 user nova-compute[74421]:   <serial>19ea07a7-9b61-464e-86f9-3705436c5c85</serial>
Oct 23 15:31:13 user nova-compute[74421]: </disk>
Oct 23 15:31:13 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Successfully updated port: 758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "refresh_cache-47d8c2ed-4c68-4c65-8727-13b7032f0bb4" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquired lock "refresh_cache-47d8c2ed-4c68-4c65-8727-13b7032f0bb4" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-changed-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Refreshing instance network info cache due to event network-changed-758f4801-fa40-41e3-83ec-7fb713ee252f. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] Acquiring lock "refresh_cache-47d8c2ed-4c68-4c65-8727-13b7032f0bb4" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:81:f1:ce, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-95f553e2-2b5d-45e0-b406-108df8dc6470 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.457s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Updating instance_info_cache with network_info: [{"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Releasing lock "refresh_cache-47d8c2ed-4c68-4c65-8727-13b7032f0bb4" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Instance network_info: |[{"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] Acquired lock "refresh_cache-47d8c2ed-4c68-4c65-8727-13b7032f0bb4" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Refreshing network info cache for port 758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Start _get_guest_xml network_info=[{"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:31:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:31:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1316797079',display_name='tempest-VolumesActionsTest-instance-1316797079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1316797079',id=27,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cfc1ff1ed441fe993ff3f5cf7606b1',ramdisk_id='',reservation_id='r-tmwb6ltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-393084464',owner_user_name='tempest-VolumesActionsTest-393084464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:31:12Z,user_data=None,user_id='912eb1b1fd73437490d09a57a8d85831',uuid=47d8c2ed-4c68-4c65-8727-13b7032f0bb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converting VIF {"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lazy-loading 'pci_devices' on Instance uuid 47d8c2ed-4c68-4c65-8727-13b7032f0bb4 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:31:13 user nova-compute[74421]:   <uuid>47d8c2ed-4c68-4c65-8727-13b7032f0bb4</uuid>
Oct 23 15:31:13 user nova-compute[74421]:   <name>instance-0000001b</name>
Oct 23 15:31:13 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:31:13 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:31:13 user nova-compute[74421]:   <metadata>
Oct 23 15:31:13 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:31:13 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:31:13 user nova-compute[74421]:       <nova:name>tempest-VolumesActionsTest-instance-1316797079</nova:name>
Oct 23 15:31:13 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:31:13</nova:creationTime>
Oct 23 15:31:13 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:31:13 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:31:13 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:31:13 user nova-compute[74421]:       <nova:owner>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:user uuid="912eb1b1fd73437490d09a57a8d85831">tempest-VolumesActionsTest-393084464-project-member</nova:user>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:project uuid="a0cfc1ff1ed441fe993ff3f5cf7606b1">tempest-VolumesActionsTest-393084464</nova:project>
Oct 23 15:31:13 user nova-compute[74421]:       </nova:owner>
Oct 23 15:31:13 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:31:13 user nova-compute[74421]:       <nova:ports>
Oct 23 15:31:13 user nova-compute[74421]:         <nova:port uuid="758f4801-fa40-41e3-83ec-7fb713ee252f">
Oct 23 15:31:13 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 15:31:13 user nova-compute[74421]:         </nova:port>
Oct 23 15:31:13 user nova-compute[74421]:       </nova:ports>
Oct 23 15:31:13 user nova-compute[74421]:     </nova:instance>
Oct 23 15:31:13 user nova-compute[74421]:   </metadata>
Oct 23 15:31:13 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:31:13 user nova-compute[74421]:     <system>
Oct 23 15:31:13 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:31:13 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:31:13 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:31:13 user nova-compute[74421]:       <entry name="serial">47d8c2ed-4c68-4c65-8727-13b7032f0bb4</entry>
Oct 23 15:31:13 user nova-compute[74421]:       <entry name="uuid">47d8c2ed-4c68-4c65-8727-13b7032f0bb4</entry>
Oct 23 15:31:13 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:31:13 user nova-compute[74421]:     </system>
Oct 23 15:31:13 user nova-compute[74421]:   </sysinfo>
Oct 23 15:31:13 user nova-compute[74421]:   <os>
Oct 23 15:31:13 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:31:13 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:31:13 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:31:13 user nova-compute[74421]:   </os>
Oct 23 15:31:13 user nova-compute[74421]:   <features>
Oct 23 15:31:13 user nova-compute[74421]:     <acpi/>
Oct 23 15:31:13 user nova-compute[74421]:     <apic/>
Oct 23 15:31:13 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:31:13 user nova-compute[74421]:   </features>
Oct 23 15:31:13 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:31:13 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:31:13 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:31:13 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:31:13 user nova-compute[74421]:   </clock>
Oct 23 15:31:13 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:31:13 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:31:13 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:31:13 user nova-compute[74421]:   </cpu>
Oct 23 15:31:13 user nova-compute[74421]:   <devices>
Oct 23 15:31:13 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:31:13 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:31:13 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk"/>
Oct 23 15:31:13 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:31:13 user nova-compute[74421]:     </disk>
Oct 23 15:31:13 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:31:13 user nova-compute[74421]:       <mac address="fa:16:3e:47:1a:75"/>
Oct 23 15:31:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:31:13 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:31:13 user nova-compute[74421]:       <target dev="tap758f4801-fa"/>
Oct 23 15:31:13 user nova-compute[74421]:     </interface>
Oct 23 15:31:13 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:31:13 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/console.log" append="off"/>
Oct 23 15:31:13 user nova-compute[74421]:     </serial>
Oct 23 15:31:13 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:31:13 user nova-compute[74421]:     <video>
Oct 23 15:31:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:31:13 user nova-compute[74421]:     </video>
Oct 23 15:31:13 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:31:13 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:31:13 user nova-compute[74421]:     </rng>
Oct 23 15:31:13 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:31:13 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:31:13 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:31:13 user nova-compute[74421]:     </memballoon>
Oct 23 15:31:13 user nova-compute[74421]:   </devices>
Oct 23 15:31:13 user nova-compute[74421]: </domain>
Oct 23 15:31:13 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1316797079',display_name='tempest-VolumesActionsTest-instance-1316797079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1316797079',id=27,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cfc1ff1ed441fe993ff3f5cf7606b1',ramdisk_id='',reservation_id='r-tmwb6ltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-393084464',owner_user_name='tempest-VolumesActionsTest-393084464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:31:12Z,user_data=None,user_id='912eb1b1fd73437490d09a57a8d85831',uuid=47d8c2ed-4c68-4c65-8727-13b7032f0bb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converting VIF {"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG os_vif [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f390822-2ec3-5e70-ac91-a61b4bf465c1', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758f4801-fa, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap758f4801-fa, col_values=(('qos', UUID('d9363beb-33c5-4492-ab48-35af4ef55678')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap758f4801-fa, col_values=(('external_ids', {'iface-id': '758f4801-fa40-41e3-83ec-7fb713ee252f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:1a:75', 'vm-uuid': '47d8c2ed-4c68-4c65-8727-13b7032f0bb4'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:31:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:13 user nova-compute[74421]: INFO os_vif [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa')
Oct 23 15:31:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:31:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] No VIF found with MAC fa:16:3e:47:1a:75, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:31:14 user nova-compute[74421]: DEBUG nova.network.neutron [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Updated VIF entry in instance network info cache for port 758f4801-fa40-41e3-83ec-7fb713ee252f. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:31:14 user nova-compute[74421]: DEBUG nova.network.neutron [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Updating instance_info_cache with network_info: [{"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:31:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0d46f63b-d46d-48a1-be91-da1de5043ddc req-597888ca-1438-4e54-8b1c-aa06d87fa540 service nova] Releasing lock "refresh_cache-47d8c2ed-4c68-4c65-8727-13b7032f0bb4" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:31:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:15 user nova-compute[74421]: INFO nova.compute.manager [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Detaching volume 19ea07a7-9b61-464e-86f9-3705436c5c85
Oct 23 15:31:15 user nova-compute[74421]: INFO nova.virt.block_device [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Attempting to driver detach volume 19ea07a7-9b61-464e-86f9-3705436c5c85 from mountpoint /dev/vdb
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Attempting to detach device vdb from instance c436795b-5a83-48e8-a98c-53dbe8c28363 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:31:15 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:31:15 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:31:15 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:31:15 user nova-compute[74421]:   <serial>19ea07a7-9b61-464e-86f9-3705436c5c85</serial>
Oct 23 15:31:15 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:31:15 user nova-compute[74421]: </disk>
Oct 23 15:31:15 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully detached device vdb from instance c436795b-5a83-48e8-a98c-53dbe8c28363 from the persistent domain config.
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c436795b-5a83-48e8-a98c-53dbe8c28363 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:31:15 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:31:15 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:31:15 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:31:15 user nova-compute[74421]:   <serial>19ea07a7-9b61-464e-86f9-3705436c5c85</serial>
Oct 23 15:31:15 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:31:15 user nova-compute[74421]: </disk>
Oct 23 15:31:15 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-ddecb457-054c-4331-a2b5-cc03cf7ea36f req-2462c224-09e5-4e0e-a8ef-59a8651c5e91 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ddecb457-054c-4331-a2b5-cc03cf7ea36f req-2462c224-09e5-4e0e-a8ef-59a8651c5e91 service nova] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ddecb457-054c-4331-a2b5-cc03cf7ea36f req-2462c224-09e5-4e0e-a8ef-59a8651c5e91 service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ddecb457-054c-4331-a2b5-cc03cf7ea36f req-2462c224-09e5-4e0e-a8ef-59a8651c5e91 service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-ddecb457-054c-4331-a2b5-cc03cf7ea36f req-2462c224-09e5-4e0e-a8ef-59a8651c5e91 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] No waiting events found dispatching network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:31:15 user nova-compute[74421]: WARNING nova.compute.manager [req-ddecb457-054c-4331-a2b5-cc03cf7ea36f req-2462c224-09e5-4e0e-a8ef-59a8651c5e91 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received unexpected event network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f for instance with vm_state building and task_state spawning.
Oct 23 15:31:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c436795b-5a83-48e8-a98c-53dbe8c28363 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:31:16 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb is timed out.
Oct 23 15:31:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Successfully detached device vdb from instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb from the live domain config.
Oct 23 15:31:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTFKMlat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '6beb0bbd-b464-4303-b817-548429ed2ee6'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:31:16 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82beeb-5ea5-48ef-bc80-a38e2ccd7241]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:31:16 user nova-compute[74421]: No targets found.
Oct 23 15:31:16 user nova-compute[74421]: iSNS:
Oct 23 15:31:16 user nova-compute[74421]: No targets found.
Oct 23 15:31:16 user nova-compute[74421]: STATIC:
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6
Oct 23 15:31:16 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:16 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:16 user nova-compute[74421]: FIRMWARE:
Oct 23 15:31:16 user nova-compute[74421]: No targets found.
Oct 23 15:31:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:31:16 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:31:16 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[038fa3ae-2f37-4ef7-a922-360e0b13d962]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bba7e5-6ad5-4f08-9cc4-141b031a289d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24783041f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6'): ({'sdi'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Removing single pathed devices sdi {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb1754-f691-4dd8-883c-9260b3ba0661]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2875d3a9-f3e8-4a15-91e4-b6163516a6ad]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Flushing IO for device /dev/sdi {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22a748-2504-4f34-9c0e-393f9ddaa979]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83d9aa-c492-45db-b054-a6c9036aba0a]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] SCSI volumes sdi have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5168ecab-8c40-4069-92ce-d91eff87f4e2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041ac9f-ba6a-45d8-b927-b55be45f72e4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260]
Oct 23 15:31:16 user nova-compute[74421]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6, portal: 172.16.0.220,3260] successful.
Oct 23 15:31:16 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beb0bbd-b464-4303-b817-548429ed2ee6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a58dc8-4854-4525-ad43-2695b7e68012]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] <== disconnect_volume: return (326ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:31:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lazy-loading 'flavor' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-739c06e9-03a7-40bf-b1da-0647e767271d tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-eaad3925-898d-4f3e-a47f-f0757c009f55 req-ffa2659b-6c11-4034-936a-dbff2be3640e service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eaad3925-898d-4f3e-a47f-f0757c009f55 req-ffa2659b-6c11-4034-936a-dbff2be3640e service nova] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eaad3925-898d-4f3e-a47f-f0757c009f55 req-ffa2659b-6c11-4034-936a-dbff2be3640e service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eaad3925-898d-4f3e-a47f-f0757c009f55 req-ffa2659b-6c11-4034-936a-dbff2be3640e service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-eaad3925-898d-4f3e-a47f-f0757c009f55 req-ffa2659b-6c11-4034-936a-dbff2be3640e service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] No waiting events found dispatching network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:31:17 user nova-compute[74421]: WARNING nova.compute.manager [req-eaad3925-898d-4f3e-a47f-f0757c009f55 req-ffa2659b-6c11-4034-936a-dbff2be3640e service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received unexpected event network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f for instance with vm_state building and task_state spawning.
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:31:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Instance spawned successfully.
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:31:17 user nova-compute[74421]: INFO nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Took 6.18 seconds to spawn the instance on the hypervisor.
Oct 23 15:31:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:31:17 user nova-compute[74421]: INFO nova.compute.manager [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Took 7.06 seconds to build instance.
Oct 23 15:31:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-160df9f1-3eba-4867-8c60-93a23817a862 tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.168s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:20 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 is timed out.
Oct 23 15:31:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully detached device vdb from instance 0879f788-a600-4bfe-b858-deec2a8b1a51 from the live domain config.
Oct 23 15:31:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfKIBrSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:31:20 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[59691c0b-8009-4a11-9541-8ea83e1a196c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:31:20 user nova-compute[74421]: No targets found.
Oct 23 15:31:20 user nova-compute[74421]: iSNS:
Oct 23 15:31:20 user nova-compute[74421]: No targets found.
Oct 23 15:31:20 user nova-compute[74421]: STATIC:
Oct 23 15:31:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882
Oct 23 15:31:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:31:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6
Oct 23 15:31:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:31:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:31:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:20 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85
Oct 23 15:31:20 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:20 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:20 user nova-compute[74421]: FIRMWARE:
Oct 23 15:31:20 user nova-compute[74421]: No targets found.
Oct 23 15:31:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:31:20 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:31:20 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a469e9ee-6d1f-455f-bc75-92d07344f2e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e274cc5-8430-4cc9-ad19-6f29e7930318]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782a4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[79340b64-13d0-439d-8486-a3c4a72fc7d3]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d017de24-acab-4582-822c-0e0faa09fc7e]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4753a110-f0ab-4953-94f2-8be68adf435b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[529a3bf3-8dc9-482a-a248-91e3426a0ad5]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e9ec77-4bbf-43cb-8c5b-0adfefb32c0f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b3e88-cdaf-4a5e-8012-e67bf5868801]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260]
Oct 23 15:31:20 user nova-compute[74421]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882, portal: 172.16.0.220,3260] successful.
Oct 23 15:31:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60bbdf62-e2ca-4d93-98f0-71b544193882 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebefa3b0-dad3-409a-9f0a-bd5bf0f1f45d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== disconnect_volume: return (326ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:31:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:31:21 user nova-compute[74421]: DEBUG nova.objects.instance [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'flavor' on Instance uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-37b2fb85-49cb-423f-83a1-6b946a21213c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.823s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:31:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:31:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:31:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:31:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:35 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c436795b-5a83-48e8-a98c-53dbe8c28363 is timed out.
Oct 23 15:31:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully detached device vdb from instance c436795b-5a83-48e8-a98c-53dbe8c28363 from the live domain config.
Oct 23 15:31:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykYLCmgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:31:35 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:31:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdaacdf-d3dc-4394-8a33-17eec4901c7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:31:35 user nova-compute[74421]: No targets found.
Oct 23 15:31:35 user nova-compute[74421]: iSNS:
Oct 23 15:31:35 user nova-compute[74421]: No targets found.
Oct 23 15:31:35 user nova-compute[74421]: STATIC:
Oct 23 15:31:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:31:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6
Oct 23 15:31:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:31:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:31:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85
Oct 23 15:31:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:31:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:31:35 user nova-compute[74421]: FIRMWARE:
Oct 23 15:31:35 user nova-compute[74421]: No targets found.
Oct 23 15:31:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:31:35 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:31:35 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a430b-8184-4cc6-89ca-a66bd83e67f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440533f-d713-4c82-904e-ddd1bd7f8933]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 (non-flash)
Oct 23 15:31:36 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24800b39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e8d1ba-6153-47d0-830d-389cf7e3eaec]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f33ec-6f8b-4d96-a760-a09c5c48dd03]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3788e867-77b4-4b13-aa82-4dcb01c3c355]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b464385e-5781-4299-8ecb-a0d4f6b9cadb]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[073feab0-91e7-41ff-9983-07214bae1779]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ccc02c-8a3c-490f-a016-86c7370c094e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260]
Oct 23 15:31:36 user nova-compute[74421]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85, portal: 172.16.0.220,3260] successful.
Oct 23 15:31:36 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ea07a7-9b61-464e-86f9-3705436c5c85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[809124c0-4b07-4d28-a411-5a1e82018ebf]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== disconnect_volume: return (343ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:31:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:31:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:37 user nova-compute[74421]: DEBUG nova.objects.instance [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid c436795b-5a83-48e8-a98c-53dbe8c28363 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-47ae97e5-0f11-48d8-a6bb-c21976c9dfc6 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.347s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:31:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:31:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:31:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:31:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updating instance_info_cache with network_info: [{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:31:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:31:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:31:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:41 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:46 user nova-compute[74421]: INFO nova.compute.manager [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Terminating instance
Oct 23 15:31:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-63eb01d1-c930-421c-ad14-f7e61ef49f16 req-83beb416-0aa7-4a0a-98ae-f294c8950cea service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-vif-unplugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-63eb01d1-c930-421c-ad14-f7e61ef49f16 req-83beb416-0aa7-4a0a-98ae-f294c8950cea service nova] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-63eb01d1-c930-421c-ad14-f7e61ef49f16 req-83beb416-0aa7-4a0a-98ae-f294c8950cea service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-63eb01d1-c930-421c-ad14-f7e61ef49f16 req-83beb416-0aa7-4a0a-98ae-f294c8950cea service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-63eb01d1-c930-421c-ad14-f7e61ef49f16 req-83beb416-0aa7-4a0a-98ae-f294c8950cea service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] No waiting events found dispatching network-vif-unplugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-63eb01d1-c930-421c-ad14-f7e61ef49f16 req-83beb416-0aa7-4a0a-98ae-f294c8950cea service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-vif-unplugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Instance destroyed successfully.
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lazy-loading 'resources' on Instance uuid 5ceb34be-c948-47d5-9efe-11c8e25a7ceb {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2127986215',display_name='tempest-TestVolumeSwap-server-2127986215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2127986215',id=18,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj4+G6ZsG1dDbNvRYrAQxUZX0vp+tYcM2H3o9BZX0Lvg5lbwypSR+tMSq9q+U3E7INvM682OqhoX8y0wiMi+f3bLaAPwvZlAY1xf8V028Pbj4E+wQkh2QPy6N0+IhB11g==',key_name='tempest-keypair-1143155814',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae443c6dfd6743a4997334b67b1250e2',ramdisk_id='',reservation_id='r-t2xhrcwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-307935136',owner_user_name='tempest-TestVolumeSwap-307935136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fefe6a440e549e1bf01b83635388a00',uuid=5ceb34be-c948-47d5-9efe-11c8e25a7ceb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Converting VIF {"id": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "address": "fa:16:3e:00:22:57", "network": {"id": "b58a8f66-ca2f-477a-9c6d-ccbc8795b60a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200607405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae443c6dfd6743a4997334b67b1250e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f9733c-bd", "ovs_interfaceid": "b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG os_vif [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0f9733c-bd, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9e0648e-1a09-4f94-bc9a-c3a7922b08d5) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:31:47 user nova-compute[74421]: INFO os_vif [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:22:57,bridge_name='br-int',has_traffic_filtering=True,id=b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d,network=Network(b58a8f66-ca2f-477a-9c6d-ccbc8795b60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f9733c-bd')
Oct 23 15:31:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Deleting instance files /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb_del
Oct 23 15:31:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Deletion of /opt/stack/data/nova/instances/5ceb34be-c948-47d5-9efe-11c8e25a7ceb_del complete
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:47 user nova-compute[74421]: INFO nova.compute.manager [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:47 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:31:47 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Took 0.76 seconds to deallocate network for instance.
Oct 23 15:31:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-df8ee279-8164-4db5-835d-1609e46040be req-dfb43ed7-e7ac-4d09-a83b-c040644e59ad service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-vif-deleted-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-9152f12a-39d0-48dd-9680-a95c119b01a9 req-80c3bf33-f3cd-4dd6-8945-8577b31c5082 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received event network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9152f12a-39d0-48dd-9680-a95c119b01a9 req-80c3bf33-f3cd-4dd6-8945-8577b31c5082 service nova] Acquiring lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9152f12a-39d0-48dd-9680-a95c119b01a9 req-80c3bf33-f3cd-4dd6-8945-8577b31c5082 service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9152f12a-39d0-48dd-9680-a95c119b01a9 req-80c3bf33-f3cd-4dd6-8945-8577b31c5082 service nova] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-9152f12a-39d0-48dd-9680-a95c119b01a9 req-80c3bf33-f3cd-4dd6-8945-8577b31c5082 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] No waiting events found dispatching network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:31:48 user nova-compute[74421]: WARNING nova.compute.manager [req-9152f12a-39d0-48dd-9680-a95c119b01a9 req-80c3bf33-f3cd-4dd6-8945-8577b31c5082 service nova] [instance: 5ceb34be-c948-47d5-9efe-11c8e25a7ceb] Received unexpected event network-vif-plugged-b0f9733c-bdbc-4a63-b7fb-bc0b1816cf1d for instance with vm_state deleted and task_state None.
Oct 23 15:31:48 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Deleted allocations for instance 5ceb34be-c948-47d5-9efe-11c8e25a7ceb
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8efef8a4-ff51-42c4-b0ec-18f0c2e90e74 tempest-TestVolumeSwap-307935136 tempest-TestVolumeSwap-307935136-project-member] Lock "5ceb34be-c948-47d5-9efe-11c8e25a7ceb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:31:49 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:31:49 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=6858MB free_disk=25.111190795898438GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0879f788-a600-4bfe-b858-deec2a8b1a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef24f4fa-32df-438e-bb56-ee4a0b32770c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance c436795b-5a83-48e8-a98c-53dbe8c28363 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 88cd91e1-d137-456b-8e26-cf3af34897e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 980791bd-c51d-4cf5-b72b-dd2262fc1f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance db43eba9-ae25-4e37-8554-39d67abe06b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 47d8c2ed-4c68-4c65-8727-13b7032f0bb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:31:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: INFO nova.compute.manager [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Terminating instance
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-a8d5e3fc-8718-4359-a900-93516eeeb785 req-8e143565-3905-4104-a83b-5a8035647b10 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-unplugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a8d5e3fc-8718-4359-a900-93516eeeb785 req-8e143565-3905-4104-a83b-5a8035647b10 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a8d5e3fc-8718-4359-a900-93516eeeb785 req-8e143565-3905-4104-a83b-5a8035647b10 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a8d5e3fc-8718-4359-a900-93516eeeb785 req-8e143565-3905-4104-a83b-5a8035647b10 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-a8d5e3fc-8718-4359-a900-93516eeeb785 req-8e143565-3905-4104-a83b-5a8035647b10 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-unplugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-a8d5e3fc-8718-4359-a900-93516eeeb785 req-8e143565-3905-4104-a83b-5a8035647b10 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-unplugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Instance destroyed successfully.
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.objects.instance [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'resources' on Instance uuid 0879f788-a600-4bfe-b858-deec2a8b1a51 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-506788264',display_name='tempest-ServerActionsTestOtherA-server-1104309008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-506788264',id=15,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmW0O5aoiaZpMBDkAmf3an82vwxyINqA/CDwM1m4iutk0cJWpJOWhGgGr5W1axIpB/Fe6m00qmB62wc7PmAYE80M80+8qw8gMXJmRIeUGjn5QOJH0K4N/UF1rhqizfqmg==',key_name='tempest-keypair-1144591236',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-y0tfs0mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=0879f788-a600-4bfe-b858-deec2a8b1a51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "05470b57-eedc-49e7-b83d-6ae2db174534", "address": "fa:16:3e:10:bf:ea", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05470b57-ee", "ovs_interfaceid": "05470b57-eedc-49e7-b83d-6ae2db174534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG os_vif [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05470b57-ee, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23bc0688-f5ef-4f9b-9b3b-72612daee4f1) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:50 user nova-compute[74421]: INFO os_vif [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:bf:ea,bridge_name='br-int',has_traffic_filtering=True,id=05470b57-eedc-49e7-b83d-6ae2db174534,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05470b57-ee')
Oct 23 15:31:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Deleting instance files /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51_del
Oct 23 15:31:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Deletion of /opt/stack/data/nova/instances/0879f788-a600-4bfe-b858-deec2a8b1a51_del complete
Oct 23 15:31:50 user nova-compute[74421]: INFO nova.compute.manager [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 15:31:50 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:31:50 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:31:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:31:51 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:31:51 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Took 0.64 seconds to deallocate network for instance.
Oct 23 15:31:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-72a4253e-f584-4154-b378-4f25ad666edd req-3ab5b0ba-40d9-41d5-bf29-9279b865fd0f service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-deleted-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:52 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Deleted allocations for instance 0879f788-a600-4bfe-b858-deec2a8b1a51
Oct 23 15:31:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7dfe7056-bc7e-407a-9c17-8cb23e1c6f50 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-f2b244a7-c48f-4467-9702-13db8b56fb3c req-26c9b7c5-a025-42f5-829c-3ee56e3ded09 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f2b244a7-c48f-4467-9702-13db8b56fb3c req-26c9b7c5-a025-42f5-829c-3ee56e3ded09 service nova] Acquiring lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f2b244a7-c48f-4467-9702-13db8b56fb3c req-26c9b7c5-a025-42f5-829c-3ee56e3ded09 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f2b244a7-c48f-4467-9702-13db8b56fb3c req-26c9b7c5-a025-42f5-829c-3ee56e3ded09 service nova] Lock "0879f788-a600-4bfe-b858-deec2a8b1a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:31:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-f2b244a7-c48f-4467-9702-13db8b56fb3c req-26c9b7c5-a025-42f5-829c-3ee56e3ded09 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] No waiting events found dispatching network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:31:52 user nova-compute[74421]: WARNING nova.compute.manager [req-f2b244a7-c48f-4467-9702-13db8b56fb3c req-26c9b7c5-a025-42f5-829c-3ee56e3ded09 service nova] [instance: 0879f788-a600-4bfe-b858-deec2a8b1a51] Received unexpected event network-vif-plugged-05470b57-eedc-49e7-b83d-6ae2db174534 for instance with vm_state deleted and task_state None.
Oct 23 15:31:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:31:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:05 user nova-compute[74421]: INFO nova.compute.manager [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Terminating instance
Oct 23 15:32:05 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Instance destroyed successfully.
Oct 23 15:32:06 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'resources' on Instance uuid c436795b-5a83-48e8-a98c-53dbe8c28363 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1017470389',display_name='tempest-AttachVolumeNegativeTest-server-1017470389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1017470389',id=22,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElSDPgRSbtGhMTKyud90mdSuUmBdd2KF71U0ZLJEr40z4HmRx6NoYOzfGsMBAFUUWrfooM9spQViPKzXMDBnUAbNWPOzBfx7OIzR9p/3kFzptuhJHCqyQ69vZ30kmlaWA==',key_name='tempest-keypair-746700191',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:29:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-77ad6fht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:29:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=c436795b-5a83-48e8-a98c-53dbe8c28363,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "address": "fa:16:3e:81:f1:ce", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4546894b-2a", "ovs_interfaceid": "4546894b-2ab7-41ef-82bd-05848f7ebd23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG os_vif [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4546894b-2a, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c45f12-ae45-4d81-a56e-d2116e5d909e) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:06 user nova-compute[74421]: INFO os_vif [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:f1:ce,bridge_name='br-int',has_traffic_filtering=True,id=4546894b-2ab7-41ef-82bd-05848f7ebd23,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4546894b-2a')
Oct 23 15:32:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Deleting instance files /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363_del
Oct 23 15:32:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Deletion of /opt/stack/data/nova/instances/c436795b-5a83-48e8-a98c-53dbe8c28363_del complete
Oct 23 15:32:06 user nova-compute[74421]: INFO nova.compute.manager [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 15:32:06 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:32:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:07 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Took 0.69 seconds to deallocate network for instance.
Oct 23 15:32:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-5a882816-eae3-42fa-85e4-4e307765cc2f req-05030af1-6924-4331-9b1b-470895cb4650 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Received event network-vif-deleted-4546894b-2ab7-41ef-82bd-05848f7ebd23 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:07 user nova-compute[74421]: INFO nova.compute.manager [req-5a882816-eae3-42fa-85e4-4e307765cc2f req-05030af1-6924-4331-9b1b-470895cb4650 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Neutron deleted interface 4546894b-2ab7-41ef-82bd-05848f7ebd23; detaching it from the instance and deleting it from the info cache
Oct 23 15:32:07 user nova-compute[74421]: DEBUG nova.network.neutron [req-5a882816-eae3-42fa-85e4-4e307765cc2f req-05030af1-6924-4331-9b1b-470895cb4650 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-5a882816-eae3-42fa-85e4-4e307765cc2f req-05030af1-6924-4331-9b1b-470895cb4650 service nova] [instance: c436795b-5a83-48e8-a98c-53dbe8c28363] Detach interface failed, port_id=4546894b-2ab7-41ef-82bd-05848f7ebd23, reason: Instance c436795b-5a83-48e8-a98c-53dbe8c28363 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:32:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:07 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Deleted allocations for instance c436795b-5a83-48e8-a98c-53dbe8c28363
Oct 23 15:32:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b9a7c64a-2377-4214-b0ef-507f14c6f6a2 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "c436795b-5a83-48e8-a98c-53dbe8c28363" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:09 user nova-compute[74421]: INFO nova.compute.manager [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Terminating instance
Oct 23 15:32:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-842142b3-d863-42fe-a1e6-96f7db0f1b5c req-f8a42087-484d-48c3-84a7-e55c8169efda service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-vif-unplugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-842142b3-d863-42fe-a1e6-96f7db0f1b5c req-f8a42087-484d-48c3-84a7-e55c8169efda service nova] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-842142b3-d863-42fe-a1e6-96f7db0f1b5c req-f8a42087-484d-48c3-84a7-e55c8169efda service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-842142b3-d863-42fe-a1e6-96f7db0f1b5c req-f8a42087-484d-48c3-84a7-e55c8169efda service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-842142b3-d863-42fe-a1e6-96f7db0f1b5c req-f8a42087-484d-48c3-84a7-e55c8169efda service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] No waiting events found dispatching network-vif-unplugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-842142b3-d863-42fe-a1e6-96f7db0f1b5c req-f8a42087-484d-48c3-84a7-e55c8169efda service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-vif-unplugged-1420182e-b77f-4c78-9b8c-f779cc342ebe for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Instance destroyed successfully.
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lazy-loading 'resources' on Instance uuid 980791bd-c51d-4cf5-b72b-dd2262fc1f82 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1508700186',display_name='tempest-VolumesActionsTest-instance-1508700186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1508700186',id=24,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d02848acb11c4ded852539e27b5a9d9f',ramdisk_id='',reservation_id='r-m1smf89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-389153627',owner_user_name='tempest-VolumesActionsTest-389153627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:09Z,user_data=None,user_id='44dbafa0de4741f6b2b899192d589bae',uuid=980791bd-c51d-4cf5-b72b-dd2262fc1f82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Converting VIF {"id": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "address": "fa:16:3e:6c:f2:54", "network": {"id": "e1823869-b751-43e9-ab6e-ae590340f219", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1159304855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02848acb11c4ded852539e27b5a9d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1420182e-b7", "ovs_interfaceid": "1420182e-b77f-4c78-9b8c-f779cc342ebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG os_vif [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1420182e-b7, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37d863c6-4f19-4776-bcf5-d977adabb408) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.compute.claims [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Claim successful on node user
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:10 user nova-compute[74421]: INFO os_vif [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f2:54,bridge_name='br-int',has_traffic_filtering=True,id=1420182e-b77f-4c78-9b8c-f779cc342ebe,network=Network(e1823869-b751-43e9-ab6e-ae590340f219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1420182e-b7')
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Deleting instance files /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82_del
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Deletion of /opt/stack/data/nova/instances/980791bd-c51d-4cf5-b72b-dd2262fc1f82_del complete
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.compute.manager [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Creating image(s)
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.policy [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd182e97e984debb9f71886b04df9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ef71af4864309b93505438743151f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:32:10 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:10 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Took 0.84 seconds to deallocate network for instance.
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-changed-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing instance network info cache due to event network-changed-dd27138c-0c34-4091-a864-fb081149be7d. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] Acquiring lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] Acquired lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Refreshing network info cache for port dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk 1073741824" returned: 0 in 0.056s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Successfully created port: 3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Cannot resize image /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Ensure instance console log exists: /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:11 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Deleted allocations for instance 980791bd-c51d-4cf5-b72b-dd2262fc1f82
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c1c2909b-12c0-4086-a2a6-46753459b1b1 tempest-VolumesActionsTest-389153627 tempest-VolumesActionsTest-389153627-project-member] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updated VIF entry in instance network info cache for port dd27138c-0c34-4091-a864-fb081149be7d. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [{"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bc2b0ba2-e217-4d29-8231-a5869497513d req-cea93fd7-aeec-4a61-a103-e135fc5bfeee service nova] Releasing lock "refresh_cache-88cd91e1-d137-456b-8e26-cf3af34897e9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] Acquiring lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] Lock "980791bd-c51d-4cf5-b72b-dd2262fc1f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] No waiting events found dispatching network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:11 user nova-compute[74421]: WARNING nova.compute.manager [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received unexpected event network-vif-plugged-1420182e-b77f-4c78-9b8c-f779cc342ebe for instance with vm_state deleted and task_state None.
Oct 23 15:32:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-eef8770c-6739-4bd3-86dd-c5ab868f314f req-2f2270cc-9d10-4a5b-be06-3de7c33da6b6 service nova] [instance: 980791bd-c51d-4cf5-b72b-dd2262fc1f82] Received event network-vif-deleted-1420182e-b77f-4c78-9b8c-f779cc342ebe {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Successfully updated port: 3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:32:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:32:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:32:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:32:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:13 user nova-compute[74421]: INFO nova.compute.manager [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] instance snapshotting
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-changed-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing instance network info cache due to event network-changed-3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance network_info: |[{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing network info cache for port 3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Start _get_guest_xml network_info=[{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:32:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:32:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-571678447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-571678447',id=28,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeDIxepctcSrFTcbLK/ccp3FKUQ7tG5yVqw4T3D9JpBAK4oJeTw5kVYD2cdrIdKMrjqMaMOt+5F1VSgudkgXPH5is6aIjzJnOJfumdleq7j7KKqSkfP14pZg+YGcSPNkw==',key_name='tempest-keypair-91007934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-yqousym9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=a43d4143-17b5-4a95-8e03-3c47568ba3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'pci_devices' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:32:13 user nova-compute[74421]:   <uuid>a43d4143-17b5-4a95-8e03-3c47568ba3e2</uuid>
Oct 23 15:32:13 user nova-compute[74421]:   <name>instance-0000001c</name>
Oct 23 15:32:13 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:32:13 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:32:13 user nova-compute[74421]:   <metadata>
Oct 23 15:32:13 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:32:13 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:32:13 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-571678447</nova:name>
Oct 23 15:32:13 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:32:13</nova:creationTime>
Oct 23 15:32:13 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:32:13 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:32:13 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:32:13 user nova-compute[74421]:       <nova:owner>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:user uuid="6fd182e97e984debb9f71886b04df9bc">tempest-AttachVolumeShelveTestJSON-1510181551-project-member</nova:user>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:project uuid="314ef71af4864309b93505438743151f">tempest-AttachVolumeShelveTestJSON-1510181551</nova:project>
Oct 23 15:32:13 user nova-compute[74421]:       </nova:owner>
Oct 23 15:32:13 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:32:13 user nova-compute[74421]:       <nova:ports>
Oct 23 15:32:13 user nova-compute[74421]:         <nova:port uuid="3275c793-6085-4756-962c-aebd39dc408a">
Oct 23 15:32:13 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:32:13 user nova-compute[74421]:         </nova:port>
Oct 23 15:32:13 user nova-compute[74421]:       </nova:ports>
Oct 23 15:32:13 user nova-compute[74421]:     </nova:instance>
Oct 23 15:32:13 user nova-compute[74421]:   </metadata>
Oct 23 15:32:13 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:32:13 user nova-compute[74421]:     <system>
Oct 23 15:32:13 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:32:13 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:32:13 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:32:13 user nova-compute[74421]:       <entry name="serial">a43d4143-17b5-4a95-8e03-3c47568ba3e2</entry>
Oct 23 15:32:13 user nova-compute[74421]:       <entry name="uuid">a43d4143-17b5-4a95-8e03-3c47568ba3e2</entry>
Oct 23 15:32:13 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:32:13 user nova-compute[74421]:     </system>
Oct 23 15:32:13 user nova-compute[74421]:   </sysinfo>
Oct 23 15:32:13 user nova-compute[74421]:   <os>
Oct 23 15:32:13 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:32:13 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:32:13 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:32:13 user nova-compute[74421]:   </os>
Oct 23 15:32:13 user nova-compute[74421]:   <features>
Oct 23 15:32:13 user nova-compute[74421]:     <acpi/>
Oct 23 15:32:13 user nova-compute[74421]:     <apic/>
Oct 23 15:32:13 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:32:13 user nova-compute[74421]:   </features>
Oct 23 15:32:13 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:32:13 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:32:13 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:32:13 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:32:13 user nova-compute[74421]:   </clock>
Oct 23 15:32:13 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:32:13 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:32:13 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:32:13 user nova-compute[74421]:   </cpu>
Oct 23 15:32:13 user nova-compute[74421]:   <devices>
Oct 23 15:32:13 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:32:13 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:32:13 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk"/>
Oct 23 15:32:13 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:32:13 user nova-compute[74421]:     </disk>
Oct 23 15:32:13 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:32:13 user nova-compute[74421]:       <mac address="fa:16:3e:5e:18:9c"/>
Oct 23 15:32:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:32:13 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:32:13 user nova-compute[74421]:       <target dev="tap3275c793-60"/>
Oct 23 15:32:13 user nova-compute[74421]:     </interface>
Oct 23 15:32:13 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:32:13 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/console.log" append="off"/>
Oct 23 15:32:13 user nova-compute[74421]:     </serial>
Oct 23 15:32:13 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:32:13 user nova-compute[74421]:     <video>
Oct 23 15:32:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:32:13 user nova-compute[74421]:     </video>
Oct 23 15:32:13 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:32:13 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:32:13 user nova-compute[74421]:     </rng>
Oct 23 15:32:13 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:32:13 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:32:13 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:32:13 user nova-compute[74421]:     </memballoon>
Oct 23 15:32:13 user nova-compute[74421]:   </devices>
Oct 23 15:32:13 user nova-compute[74421]: </domain>
Oct 23 15:32:13 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-571678447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-571678447',id=28,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeDIxepctcSrFTcbLK/ccp3FKUQ7tG5yVqw4T3D9JpBAK4oJeTw5kVYD2cdrIdKMrjqMaMOt+5F1VSgudkgXPH5is6aIjzJnOJfumdleq7j7KKqSkfP14pZg+YGcSPNkw==',key_name='tempest-keypair-91007934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-yqousym9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=a43d4143-17b5-4a95-8e03-3c47568ba3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG os_vif [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:32:13 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Beginning live snapshot process
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93fbeaa9-189f-54cf-9032-5c6a5af12ff9', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3275c793-60, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3275c793-60, col_values=(('qos', UUID('e8305ab5-cab9-4efd-92bf-32eb76774997')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3275c793-60, col_values=(('external_ids', {'iface-id': '3275c793-6085-4756-962c-aebd39dc408a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:18:9c', 'vm-uuid': 'a43d4143-17b5-4a95-8e03-3c47568ba3e2'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:13 user nova-compute[74421]: INFO os_vif [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60')
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No VIF found with MAC fa:16:3e:5e:18:9c, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:13 user nova-compute[74421]: INFO nova.compute.manager [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Terminating instance
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updated VIF entry in instance network info cache for port 3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a5122a43-e028-4218-985f-1aabebddb1fd req-eb0daf1a-0dcb-4c04-b083-67fac8c867a1 service nova] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnh087fj3/403d94045c474d9ab943b53d94fe40fd.delta 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-31ce7eed-fe68-4a84-b70c-e5b1e88e81cb req-250e9685-ea72-41e5-8863-fc22044bd96e service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31ce7eed-fe68-4a84-b70c-e5b1e88e81cb req-250e9685-ea72-41e5-8863-fc22044bd96e service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31ce7eed-fe68-4a84-b70c-e5b1e88e81cb req-250e9685-ea72-41e5-8863-fc22044bd96e service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31ce7eed-fe68-4a84-b70c-e5b1e88e81cb req-250e9685-ea72-41e5-8863-fc22044bd96e service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-31ce7eed-fe68-4a84-b70c-e5b1e88e81cb req-250e9685-ea72-41e5-8863-fc22044bd96e service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-31ce7eed-fe68-4a84-b70c-e5b1e88e81cb req-250e9685-ea72-41e5-8863-fc22044bd96e service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-dd27138c-0c34-4091-a864-fb081149be7d for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnh087fj3/403d94045c474d9ab943b53d94fe40fd.delta 1073741824" returned: 0 in 0.057s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-66c291ff-fef9-47d9-99dd-16c050854489 req-1678336e-444b-47db-98cc-496e76a491ce service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66c291ff-fef9-47d9-99dd-16c050854489 req-1678336e-444b-47db-98cc-496e76a491ce service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66c291ff-fef9-47d9-99dd-16c050854489 req-1678336e-444b-47db-98cc-496e76a491ce service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-66c291ff-fef9-47d9-99dd-16c050854489 req-1678336e-444b-47db-98cc-496e76a491ce service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-66c291ff-fef9-47d9-99dd-16c050854489 req-1678336e-444b-47db-98cc-496e76a491ce service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-66c291ff-fef9-47d9-99dd-16c050854489 req-1678336e-444b-47db-98cc-496e76a491ce service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] COPY block job progress, current cursor: 1900544 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-f14032b2-c829-4282-b534-6fa8bee39902 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:15 user nova-compute[74421]: WARNING nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-f14032b2-c829-4282-b534-6fa8bee39902 for instance with vm_state active and task_state deleting.
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:15 user nova-compute[74421]: WARNING nova.compute.manager [req-de4c95fc-7478-42d0-82ac-4f742432e3c5 req-e8d82995-c823-4f4b-937c-8fd9d1e5428c service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-df6223ec-5382-483f-b5ca-f3935d48f1f6 for instance with vm_state active and task_state deleting.
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:32:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 15:32:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Instance destroyed successfully.
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lazy-loading 'resources' on Instance uuid 88cd91e1-d137-456b-8e26-cf3af34897e9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd27138c-0c, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:32:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnh087fj3/403d94045c474d9ab943b53d94fe40fd.delta /opt/stack/data/nova/instances/snapshots/tmpnh087fj3/403d94045c474d9ab943b53d94fe40fd {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e55e20f2-b762-4b21-975e-8202e5884fcc) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c1:58,bridge_name='br-int',has_traffic_filtering=True,id=dd27138c-0c34-4091-a864-fb081149be7d,network=Network(4531061e-4b7e-453f-881d-c27c35de3e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27138c-0c')
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap506ec095-04, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: WARNING nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-dd27138c-0c34-4091-a864-fb081149be7d for instance with vm_state active and task_state deleting.
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: WARNING nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-506ec095-0405-4a3f-aa55-b5b69ee1b40a for instance with vm_state active and task_state deleting.
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-02c54509-9397-4304-af9f-57db3a519762 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: WARNING nova.compute.manager [req-8b3dbfad-6764-4717-b8c3-34a0f8b2c51c req-17a3f3b4-fd0d-48b7-9f13-f4ec28fe9a6d service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-02c54509-9397-4304-af9f-57db3a519762 for instance with vm_state active and task_state deleting.
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72d9a2d9-acf9-4248-81d8-88baba4767ef) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnh087fj3/403d94045c474d9ab943b53d94fe40fd.delta /opt/stack/data/nova/instances/snapshots/tmpnh087fj3/403d94045c474d9ab943b53d94fe40fd" returned: 0 in 0.499s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Snapshot extracted, beginning image upload
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: WARNING nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-7e84e93c-a147-4453-ba0e-6109068ca0d9 for instance with vm_state active and task_state deleting.
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-unplugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-unplugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Acquiring lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] No waiting events found dispatching network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:16 user nova-compute[74421]: WARNING nova.compute.manager [req-3ea60579-9918-4ad1-91e9-5599bcb62540 req-2792a0ce-9133-4b3b-b043-b74ba696b1d2 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received unexpected event network-vif-plugged-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb for instance with vm_state active and task_state deleting.
Oct 23 15:32:16 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:29,bridge_name='br-int',has_traffic_filtering=True,id=506ec095-0405-4a3f-aa55-b5b69ee1b40a,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap506ec095-04')
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e84e93c-a1, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21a113f3-b957-40fc-b7db-c365aea10f22) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:aa:96,bridge_name='br-int',has_traffic_filtering=True,id=7e84e93c-a147-4453-ba0e-6109068ca0d9,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e84e93c-a1')
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf14032b2-c8, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1e2fe17-f30d-449b-8f77-b1f8cfb01482) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f14032b2-c829-4282-b534-6fa8bee39902,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14032b2-c8')
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf6223ec-53, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d75a2352-af3e-4e9b-a2eb-857141cf71d6) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6f:73,bridge_name='br-int',has_traffic_filtering=True,id=df6223ec-5382-483f-b5ca-f3935d48f1f6,network=Network(66b9731e-7005-4246-a2fa-df576115758d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6223ec-53')
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "02c54509-9397-4304-af9f-57db3a519762", "address": "fa:16:3e:a5:4c:e5", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c54509-93", "ovs_interfaceid": "02c54509-9397-4304-af9f-57db3a519762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02c54509-93, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80d99afa-e8b3-45c9-b21d-057699bf994e) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:4c:e5,bridge_name='br-int',has_traffic_filtering=True,id=02c54509-9397-4304-af9f-57db3a519762,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c54509-93')
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-454683299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-454683299',id=23,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE29T2z+TtKfVHWb7xPaOUUgjGsmU1bDtQN7C/6G5cEmx16596d5KPyBp3IHlYwS71UWQTxVsP7/aYJ6h3zQnCjcIBYQLQLhO4W2THEQ2aX2VObMonBAe/FbGcf7gphwA==',key_name='tempest-keypair-196201863',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c929d756f2f54ce4bceb88868166e598',ramdisk_id='',reservation_id='r-611fggti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-797598540',owner_user_name='tempest-TaggedBootDevicesTest_v242-797598540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5300248ea78420c8cacd668de1f8932',uuid=88cd91e1-d137-456b-8e26-cf3af34897e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converting VIF {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebfd46d6-2e, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11ee5bae-00c6-44ee-8d65-5f5cf4f266bc) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:17 user nova-compute[74421]: INFO os_vif [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:fa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb,network=Network(b84dbbda-0d6a-4087-86a9-0d32d0108300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfd46d6-2e')
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbuTCBcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:32:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a3af6-57be-4144-b90b-ffd3d61002da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]: iSNS:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]: STATIC:
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: FIRMWARE:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:32:17 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:32:17 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6269d834-4878-4fa7-8d67-7b30957ffe68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c2e3d-6a4b-485f-8f7f-c5f6a6348622]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782fd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[533af525-dbc0-4ac0-ab0d-a159ca2f8b37]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93864f0-5f14-4260-9e7f-d73c6610bc2f]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:17 user nova-compute[74421]: WARNING nova.compute.manager [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state building and task_state spawning.
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:17 user nova-compute[74421]: WARNING nova.compute.manager [req-9e8a215b-85b9-4821-aabf-a93d3171a2e5 req-b5777f5d-1b4e-4760-8d32-3b5419dfe8b1 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state building and task_state spawning.
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e578a89c-937c-4d31-b607-cb876e0b52e5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2c795-c98e-4664-8314-34e64dc4b46d]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381d655-073e-4464-9949-ad7121a6ea1d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ab7e7-b6eb-4a34-a355-1775f1de88c9]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260]
Oct 23 15:32:17 user nova-compute[74421]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6, portal: 172.16.0.220,3260] successful.
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90fdf0f-0dbf-4ca3-9aa0-b27eb9c741d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[605770ab-d0a2-458f-95c4-71479d56cd88]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== disconnect_volume: return (378ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FckQedyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:32:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24078192-4807-4312-b193-35639d08b6d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]: iSNS:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]: STATIC:
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: FIRMWARE:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:32:17 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:32:17 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7168ad75-cca4-4f41-8ec5-4eaf1ba1dcae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8129f945-b841-4f0c-bac8-afe87050002b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782f52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa'): ({'sdg'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Removing single pathed devices sdg {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1937787a-22d7-484d-9914-edaa3f1f5bd8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[165918b4-1162-49c5-9308-2a4083c315af]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Flushing IO for device /dev/sdg {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc53eea2-768b-4fcd-a54c-4c3ed4d7485b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fa01cd-6f75-4328-9be1-e031c332c815]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] SCSI volumes sdg have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e289c9a-edf3-4091-9979-06277af3e84a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13237e0-8539-4ac8-a82e-5d54d991c9f3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260]
Oct 23 15:32:17 user nova-compute[74421]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa, portal: 172.16.0.220,3260] successful.
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4351761a-c02a-42ec-a35f-8172df04b9aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[66825f7b-6549-4829-9836-6573db1a9d82]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== disconnect_volume: return (366ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcYUuoXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:32:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80cdf15-af93-4cad-ae2e-5aa1ae0c6986]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]: iSNS:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]: STATIC:
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352
Oct 23 15:32:17 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:32:17 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:32:17 user nova-compute[74421]: FIRMWARE:
Oct 23 15:32:17 user nova-compute[74421]: No targets found.
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:32:17 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:32:17 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559088d-06c3-40ec-85ff-169ee3fd2bd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab20711-267d-4736-aa34-702fdfdac902]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 (non-flash)
Oct 23 15:32:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782f52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352'): ({'sdh'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Removing single pathed devices sdh {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:32:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba1198-7f97-45af-a67e-3df04f87556f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1050b3-3fd6-4072-ba0c-a2096089c8b4]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Flushing IO for device /dev/sdh {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d805d0c8-a332-4120-827f-ed8c5c969fad]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0000c-7073-48e5-aa63-2ef0bd6fd454]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e60cc32-7728-430f-9bcc-563f4be96751]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf01070-107a-4c8d-88d7-840d94c820ac]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260]
Oct 23 15:32:18 user nova-compute[74421]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352, portal: 172.16.0.220,3260] successful.
Oct 23 15:32:18 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b803a2-7485-4f08-b5b7-f845312d5352 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d20838-357e-49ba-90bd-50006e4783ed]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] <== disconnect_volume: return (339ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:32:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Deleting instance files /opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9_del
Oct 23 15:32:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Deletion of /opt/stack/data/nova/instances/88cd91e1-d137-456b-8e26-cf3af34897e9_del complete
Oct 23 15:32:18 user nova-compute[74421]: INFO nova.compute.manager [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Took 4.53 seconds to destroy the instance on the hypervisor.
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:32:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance spawned successfully.
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:32:18 user nova-compute[74421]: INFO nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Took 7.67 seconds to spawn the instance on the hypervisor.
Oct 23 15:32:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:32:18 user nova-compute[74421]: INFO nova.compute.manager [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Took 8.64 seconds to build instance.
Oct 23 15:32:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e201d0d2-7f46-4a51-a03a-6a51d5cde80c tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.771s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Snapshot image upload complete
Oct 23 15:32:19 user nova-compute[74421]: INFO nova.compute.manager [None req-f20c68b6-66e4-4859-9857-cc293060e019 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Took 6.64 seconds to snapshot the instance on the hypervisor.
Oct 23 15:32:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b238a79-7b60-4f95-835d-61e2e193ddc3 req-b70916d4-f08c-4ce6-8d27-17437c3a76ed service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-deleted-02c54509-9397-4304-af9f-57db3a519762 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:20 user nova-compute[74421]: INFO nova.compute.manager [req-9b238a79-7b60-4f95-835d-61e2e193ddc3 req-b70916d4-f08c-4ce6-8d27-17437c3a76ed service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Neutron deleted interface 02c54509-9397-4304-af9f-57db3a519762; detaching it from the instance and deleting it from the info cache
Oct 23 15:32:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-9b238a79-7b60-4f95-835d-61e2e193ddc3 req-b70916d4-f08c-4ce6-8d27-17437c3a76ed service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [{"id": "dd27138c-0c34-4091-a864-fb081149be7d", "address": "fa:16:3e:bb:c1:58", "network": {"id": "4531061e-4b7e-453f-881d-c27c35de3e3d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-843628728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27138c-0c", "ovs_interfaceid": "dd27138c-0c34-4091-a864-fb081149be7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "address": "fa:16:3e:ea:f3:29", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506ec095-04", "ovs_interfaceid": "506ec095-0405-4a3f-aa55-b5b69ee1b40a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "address": "fa:16:3e:49:aa:96", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e84e93c-a1", "ovs_interfaceid": "7e84e93c-a147-4453-ba0e-6109068ca0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f14032b2-c829-4282-b534-6fa8bee39902", "address": "fa:16:3e:34:1d:d6", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14032b2-c8", "ovs_interfaceid": "f14032b2-c829-4282-b534-6fa8bee39902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "address": "fa:16:3e:62:6f:73", "network": {"id": "66b9731e-7005-4246-a2fa-df576115758d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934894343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6223ec-53", "ovs_interfaceid": "df6223ec-5382-483f-b5ca-f3935d48f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "address": "fa:16:3e:7b:fa:b7", "network": {"id": "b84dbbda-0d6a-4087-86a9-0d32d0108300", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581386483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c929d756f2f54ce4bceb88868166e598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfd46d6-2e", "ovs_interfaceid": "ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-9b238a79-7b60-4f95-835d-61e2e193ddc3 req-b70916d4-f08c-4ce6-8d27-17437c3a76ed service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Detach interface failed, port_id=02c54509-9397-4304-af9f-57db3a519762, reason: Instance 88cd91e1-d137-456b-8e26-cf3af34897e9 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:32:21 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:21 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Took 3.63 seconds to deallocate network for instance.
Oct 23 15:32:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-7723a692-70f7-45b0-b198-b29ac55fd8be req-1f416a58-a97e-4df2-b501-1119ef92b216 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-deleted-ebfd46d6-2e7e-47d0-a75a-d3fd2f049adb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-7723a692-70f7-45b0-b198-b29ac55fd8be req-1f416a58-a97e-4df2-b501-1119ef92b216 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-deleted-f14032b2-c829-4282-b534-6fa8bee39902 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-7723a692-70f7-45b0-b198-b29ac55fd8be req-1f416a58-a97e-4df2-b501-1119ef92b216 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-deleted-dd27138c-0c34-4091-a864-fb081149be7d {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-7723a692-70f7-45b0-b198-b29ac55fd8be req-1f416a58-a97e-4df2-b501-1119ef92b216 service nova] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Received event network-vif-deleted-df6223ec-5382-483f-b5ca-f3935d48f1f6 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:24 user nova-compute[74421]: INFO nova.compute.manager [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] [instance: 88cd91e1-d137-456b-8e26-cf3af34897e9] Took 2.53 seconds to detach 3 volumes for instance.
Oct 23 15:32:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:24 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:32:24 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:32:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:24 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Deleted allocations for instance 88cd91e1-d137-456b-8e26-cf3af34897e9
Oct 23 15:32:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-7051d046-4afb-4131-9919-4a9df43b189c tempest-TaggedBootDevicesTest_v242-797598540 tempest-TaggedBootDevicesTest_v242-797598540-project-member] Lock "88cd91e1-d137-456b-8e26-cf3af34897e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.209s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:28 user nova-compute[74421]: INFO nova.compute.manager [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Terminating instance
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-fca4164d-f2f7-4b26-9913-403c62bcc1f8 req-33d822a4-a121-4c8a-8e0c-84af434ed9cb service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-vif-unplugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fca4164d-f2f7-4b26-9913-403c62bcc1f8 req-33d822a4-a121-4c8a-8e0c-84af434ed9cb service nova] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fca4164d-f2f7-4b26-9913-403c62bcc1f8 req-33d822a4-a121-4c8a-8e0c-84af434ed9cb service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-fca4164d-f2f7-4b26-9913-403c62bcc1f8 req-33d822a4-a121-4c8a-8e0c-84af434ed9cb service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-fca4164d-f2f7-4b26-9913-403c62bcc1f8 req-33d822a4-a121-4c8a-8e0c-84af434ed9cb service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] No waiting events found dispatching network-vif-unplugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-fca4164d-f2f7-4b26-9913-403c62bcc1f8 req-33d822a4-a121-4c8a-8e0c-84af434ed9cb service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-vif-unplugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:32:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Instance destroyed successfully.
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'resources' on Instance uuid db43eba9-ae25-4e37-8554-39d67abe06b1 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-268343569',display_name='tempest-VolumesAdminNegativeTest-server-268343569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-268343569',id=25,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdf1350aabad4540a2afb76a166a3a0e',ramdisk_id='',reservation_id='r-248kjmms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1598499002',owner_user_name='tempest-VolumesAdminNegativeTest-1598499002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:17Z,user_data=None,user_id='bfeb2fd3197444f89abc351a2ac1dfa6',uuid=db43eba9-ae25-4e37-8554-39d67abe06b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converting VIF {"id": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "address": "fa:16:3e:f5:c6:1e", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afd6b20-96", "ovs_interfaceid": "1afd6b20-961f-4a00-ab48-6bc5a97d6acc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG os_vif [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1afd6b20-96, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68e6041e-2d31-43f6-9300-1aa82b42ee64) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:28 user nova-compute[74421]: INFO os_vif [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c6:1e,bridge_name='br-int',has_traffic_filtering=True,id=1afd6b20-961f-4a00-ab48-6bc5a97d6acc,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afd6b20-96')
Oct 23 15:32:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Deleting instance files /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1_del
Oct 23 15:32:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Deletion of /opt/stack/data/nova/instances/db43eba9-ae25-4e37-8554-39d67abe06b1_del complete
Oct 23 15:32:28 user nova-compute[74421]: INFO nova.compute.manager [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 23 15:32:28 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:32:28 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:32:29 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:29 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Took 0.47 seconds to deallocate network for instance.
Oct 23 15:32:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-39bf3173-8d0d-4c28-a688-e4080bced63b req-7129a9bd-740a-4cf4-a6e1-f1fdab9fd930 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-vif-deleted-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:29 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:32:29 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:32:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:29 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Deleted allocations for instance db43eba9-ae25-4e37-8554-39d67abe06b1
Oct 23 15:32:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e43bdf00-f8af-40ed-86c0-fc142eeba1ae tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-5dd311e2-74d2-499c-ba23-fb29d53dd2ad req-af22e2c3-ca99-4130-b9eb-ad6883ea35c5 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received event network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:32:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5dd311e2-74d2-499c-ba23-fb29d53dd2ad req-af22e2c3-ca99-4130-b9eb-ad6883ea35c5 service nova] Acquiring lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5dd311e2-74d2-499c-ba23-fb29d53dd2ad req-af22e2c3-ca99-4130-b9eb-ad6883ea35c5 service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5dd311e2-74d2-499c-ba23-fb29d53dd2ad req-af22e2c3-ca99-4130-b9eb-ad6883ea35c5 service nova] Lock "db43eba9-ae25-4e37-8554-39d67abe06b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-5dd311e2-74d2-499c-ba23-fb29d53dd2ad req-af22e2c3-ca99-4130-b9eb-ad6883ea35c5 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] No waiting events found dispatching network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:32:30 user nova-compute[74421]: WARNING nova.compute.manager [req-5dd311e2-74d2-499c-ba23-fb29d53dd2ad req-af22e2c3-ca99-4130-b9eb-ad6883ea35c5 service nova] [instance: db43eba9-ae25-4e37-8554-39d67abe06b1] Received unexpected event network-vif-plugged-1afd6b20-961f-4a00-ab48-6bc5a97d6acc for instance with vm_state deleted and task_state None.
Oct 23 15:32:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:32:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:32:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:32:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:32:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:32:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:32:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:32:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:32:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:32:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:32:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:48 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:32:48 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:32:48 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=25.152812957763672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef24f4fa-32df-438e-bb56-ee4a0b32770c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 47d8c2ed-4c68-4c65-8727-13b7032f0bb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:32:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:32:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:50 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:50 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:32:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:32:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:32:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:32:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:32:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:32:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:33:00 user nova-compute[74421]: INFO nova.compute.claims [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Claim successful on node user
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:33:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.policy [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e711d55fe644a0ca518fa34d187b79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e90bcb97e74feaa5e6247b7fc0d3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:33:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Creating image(s)
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "/opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk 1073741824" returned: 0 in 0.053s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Successfully created port: f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Cannot resize image /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Ensure instance console log exists: /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:01 user nova-compute[74421]: INFO nova.compute.manager [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Terminating instance
Oct 23 15:33:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Successfully updated port: f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquired lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-changed-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Refreshing instance network info cache due to event network-changed-f3e9f491-f219-4b09-b93f-fd0192567eef. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] Acquiring lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-9772ac7a-0962-463d-a7d1-3d70c7b7266a req-1a16d7d6-9bf2-40a7-a988-1f97e5188d12 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-vif-unplugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9772ac7a-0962-463d-a7d1-3d70c7b7266a req-1a16d7d6-9bf2-40a7-a988-1f97e5188d12 service nova] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9772ac7a-0962-463d-a7d1-3d70c7b7266a req-1a16d7d6-9bf2-40a7-a988-1f97e5188d12 service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9772ac7a-0962-463d-a7d1-3d70c7b7266a req-1a16d7d6-9bf2-40a7-a988-1f97e5188d12 service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-9772ac7a-0962-463d-a7d1-3d70c7b7266a req-1a16d7d6-9bf2-40a7-a988-1f97e5188d12 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] No waiting events found dispatching network-vif-unplugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-9772ac7a-0962-463d-a7d1-3d70c7b7266a req-1a16d7d6-9bf2-40a7-a988-1f97e5188d12 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-vif-unplugged-758f4801-fa40-41e3-83ec-7fb713ee252f for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updating instance_info_cache with network_info: [{"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Releasing lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Instance network_info: |[{"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] Acquired lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.neutron [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Refreshing network info cache for port f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Start _get_guest_xml network_info=[{"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:33:02 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:02 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:33:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Instance destroyed successfully.
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1643621896',display_name='tempest-AttachVolumeNegativeTest-server-1643621896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1643621896',id=29,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTjX0fq+IENZeripwsShLRTE/suUj7lTdVSeqgF9GBeT+s6jxtWZ+xJ4K2cSi6bz4Sdt8JmiuaZiZnTSm3kgelv1QUKglh0H6oPHYzNXj9zn9tnVlMV7xN0zxaTbwAkw==',key_name='tempest-keypair-449066379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-7gmylesb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.objects.instance [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'pci_devices' on Instance uuid a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.objects.instance [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lazy-loading 'resources' on Instance uuid 47d8c2ed-4c68-4c65-8727-13b7032f0bb4 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:33:02 user nova-compute[74421]:   <uuid>a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22</uuid>
Oct 23 15:33:02 user nova-compute[74421]:   <name>instance-0000001d</name>
Oct 23 15:33:02 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:33:02 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:33:02 user nova-compute[74421]:   <metadata>
Oct 23 15:33:02 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:33:02 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:33:02 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1643621896</nova:name>
Oct 23 15:33:02 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:33:02</nova:creationTime>
Oct 23 15:33:02 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:33:02 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:33:02 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:33:02 user nova-compute[74421]:       <nova:owner>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:user uuid="1e711d55fe644a0ca518fa34d187b79f">tempest-AttachVolumeNegativeTest-100322526-project-member</nova:user>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:project uuid="74e90bcb97e74feaa5e6247b7fc0d3f2">tempest-AttachVolumeNegativeTest-100322526</nova:project>
Oct 23 15:33:02 user nova-compute[74421]:       </nova:owner>
Oct 23 15:33:02 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:33:02 user nova-compute[74421]:       <nova:ports>
Oct 23 15:33:02 user nova-compute[74421]:         <nova:port uuid="f3e9f491-f219-4b09-b93f-fd0192567eef">
Oct 23 15:33:02 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 15:33:02 user nova-compute[74421]:         </nova:port>
Oct 23 15:33:02 user nova-compute[74421]:       </nova:ports>
Oct 23 15:33:02 user nova-compute[74421]:     </nova:instance>
Oct 23 15:33:02 user nova-compute[74421]:   </metadata>
Oct 23 15:33:02 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:33:02 user nova-compute[74421]:     <system>
Oct 23 15:33:02 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:33:02 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:33:02 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:33:02 user nova-compute[74421]:       <entry name="serial">a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22</entry>
Oct 23 15:33:02 user nova-compute[74421]:       <entry name="uuid">a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22</entry>
Oct 23 15:33:02 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:33:02 user nova-compute[74421]:     </system>
Oct 23 15:33:02 user nova-compute[74421]:   </sysinfo>
Oct 23 15:33:02 user nova-compute[74421]:   <os>
Oct 23 15:33:02 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:33:02 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:33:02 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:33:02 user nova-compute[74421]:   </os>
Oct 23 15:33:02 user nova-compute[74421]:   <features>
Oct 23 15:33:02 user nova-compute[74421]:     <acpi/>
Oct 23 15:33:02 user nova-compute[74421]:     <apic/>
Oct 23 15:33:02 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:33:02 user nova-compute[74421]:   </features>
Oct 23 15:33:02 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:33:02 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:33:02 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:33:02 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:33:02 user nova-compute[74421]:   </clock>
Oct 23 15:33:02 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:33:02 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:33:02 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:33:02 user nova-compute[74421]:   </cpu>
Oct 23 15:33:02 user nova-compute[74421]:   <devices>
Oct 23 15:33:02 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:33:02 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:33:02 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk"/>
Oct 23 15:33:02 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:33:02 user nova-compute[74421]:     </disk>
Oct 23 15:33:02 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:33:02 user nova-compute[74421]:       <mac address="fa:16:3e:f4:ae:41"/>
Oct 23 15:33:02 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:33:02 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:33:02 user nova-compute[74421]:       <target dev="tapf3e9f491-f2"/>
Oct 23 15:33:02 user nova-compute[74421]:     </interface>
Oct 23 15:33:02 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:33:02 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/console.log" append="off"/>
Oct 23 15:33:02 user nova-compute[74421]:     </serial>
Oct 23 15:33:02 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:33:02 user nova-compute[74421]:     <video>
Oct 23 15:33:02 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:33:02 user nova-compute[74421]:     </video>
Oct 23 15:33:02 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:33:02 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:33:02 user nova-compute[74421]:     </rng>
Oct 23 15:33:02 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:33:02 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:33:02 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:33:02 user nova-compute[74421]:     </memballoon>
Oct 23 15:33:02 user nova-compute[74421]:   </devices>
Oct 23 15:33:02 user nova-compute[74421]: </domain>
Oct 23 15:33:02 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1643621896',display_name='tempest-AttachVolumeNegativeTest-server-1643621896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1643621896',id=29,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTjX0fq+IENZeripwsShLRTE/suUj7lTdVSeqgF9GBeT+s6jxtWZ+xJ4K2cSi6bz4Sdt8JmiuaZiZnTSm3kgelv1QUKglh0H6oPHYzNXj9zn9tnVlMV7xN0zxaTbwAkw==',key_name='tempest-keypair-449066379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-7gmylesb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG os_vif [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1316797079',display_name='tempest-VolumesActionsTest-instance-1316797079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1316797079',id=27,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:31:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cfc1ff1ed441fe993ff3f5cf7606b1',ramdisk_id='',reservation_id='r-tmwb6ltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-393084464',owner_user_name='tempest-VolumesActionsTest-393084464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:31:18Z,user_data=None,user_id='912eb1b1fd73437490d09a57a8d85831',uuid=47d8c2ed-4c68-4c65-8727-13b7032f0bb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converting VIF {"id": "758f4801-fa40-41e3-83ec-7fb713ee252f", "address": "fa:16:3e:47:1a:75", "network": {"id": "3a18a87a-4a78-4f99-be8a-fac7bc9c7678", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1837743110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cfc1ff1ed441fe993ff3f5cf7606b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758f4801-fa", "ovs_interfaceid": "758f4801-fa40-41e3-83ec-7fb713ee252f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG os_vif [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc4ae1e2-4cbc-5d24-8277-15980e582948', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758f4801-fa, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3e9f491-f2, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3e9f491-f2, col_values=(('qos', UUID('fa6d75cc-01a3-4c28-8a11-373b78627e90')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3e9f491-f2, col_values=(('external_ids', {'iface-id': 'f3e9f491-f219-4b09-b93f-fd0192567eef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ae:41', 'vm-uuid': 'a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: INFO os_vif [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2')
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9363beb-33c5-4492-ab48-35af4ef55678) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:02 user nova-compute[74421]: INFO os_vif [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1a:75,bridge_name='br-int',has_traffic_filtering=True,id=758f4801-fa40-41e3-83ec-7fb713ee252f,network=Network(3a18a87a-4a78-4f99-be8a-fac7bc9c7678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758f4801-fa')
Oct 23 15:33:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Deleting instance files /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4_del
Oct 23 15:33:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Deletion of /opt/stack/data/nova/instances/47d8c2ed-4c68-4c65-8727-13b7032f0bb4_del complete
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:f4:ae:41, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:33:03 user nova-compute[74421]: INFO nova.compute.manager [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 23 15:33:03 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updated VIF entry in instance network info cache for port f3e9f491-f219-4b09-b93f-fd0192567eef. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updating instance_info_cache with network_info: [{"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd3df252-1499-4478-a209-b4f444d8ad94 req-b45d628e-d060-4e61-8819-0fe5cea310ae service nova] Releasing lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:03 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Took 0.46 seconds to deallocate network for instance.
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-fc3cb040-3880-465e-923b-9e0af6a0c5e0 req-faa732ef-f5f8-41e2-8684-2b036df24b2d service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-vif-deleted-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:03 user nova-compute[74421]: INFO nova.compute.manager [req-fc3cb040-3880-465e-923b-9e0af6a0c5e0 req-faa732ef-f5f8-41e2-8684-2b036df24b2d service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Neutron deleted interface 758f4801-fa40-41e3-83ec-7fb713ee252f; detaching it from the instance and deleting it from the info cache
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-fc3cb040-3880-465e-923b-9e0af6a0c5e0 req-faa732ef-f5f8-41e2-8684-2b036df24b2d service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-fc3cb040-3880-465e-923b-9e0af6a0c5e0 req-faa732ef-f5f8-41e2-8684-2b036df24b2d service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Detach interface failed, port_id=758f4801-fa40-41e3-83ec-7fb713ee252f, reason: Instance 47d8c2ed-4c68-4c65-8727-13b7032f0bb4 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:04 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Deleted allocations for instance 47d8c2ed-4c68-4c65-8727-13b7032f0bb4
Oct 23 15:33:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-07afda74-9086-4d61-aab5-7677f4e8915b tempest-VolumesActionsTest-393084464 tempest-VolumesActionsTest-393084464-project-member] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-72718126-20d4-4f93-b8a2-d285eb91e62f req-080e3fe4-9532-4da7-8f4b-62099f56fd85 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received event network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-72718126-20d4-4f93-b8a2-d285eb91e62f req-080e3fe4-9532-4da7-8f4b-62099f56fd85 service nova] Acquiring lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-72718126-20d4-4f93-b8a2-d285eb91e62f req-080e3fe4-9532-4da7-8f4b-62099f56fd85 service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-72718126-20d4-4f93-b8a2-d285eb91e62f req-080e3fe4-9532-4da7-8f4b-62099f56fd85 service nova] Lock "47d8c2ed-4c68-4c65-8727-13b7032f0bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-72718126-20d4-4f93-b8a2-d285eb91e62f req-080e3fe4-9532-4da7-8f4b-62099f56fd85 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] No waiting events found dispatching network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:04 user nova-compute[74421]: WARNING nova.compute.manager [req-72718126-20d4-4f93-b8a2-d285eb91e62f req-080e3fe4-9532-4da7-8f4b-62099f56fd85 service nova] [instance: 47d8c2ed-4c68-4c65-8727-13b7032f0bb4] Received unexpected event network-vif-plugged-758f4801-fa40-41e3-83ec-7fb713ee252f for instance with vm_state deleted and task_state None.
Oct 23 15:33:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:06 user nova-compute[74421]: WARNING nova.compute.manager [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received unexpected event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with vm_state building and task_state spawning.
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:06 user nova-compute[74421]: WARNING nova.compute.manager [req-f8a00075-ec6b-4f38-af74-0c055a4a4a7f req-d003b7f9-0937-4d87-9adc-2b9a0cf5364b service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received unexpected event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with vm_state building and task_state spawning.
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:33:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Instance spawned successfully.
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:33:06 user nova-compute[74421]: INFO nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Took 6.11 seconds to spawn the instance on the hypervisor.
Oct 23 15:33:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:33:07 user nova-compute[74421]: INFO nova.compute.manager [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Took 7.03 seconds to build instance.
Oct 23 15:33:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5a11cec2-b34c-43b4-94ec-7df729074fef tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.141s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:33:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:33:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:33:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:33:22 user nova-compute[74421]: INFO nova.compute.claims [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Claim successful on node user
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:33:22 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG nova.policy [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '166776dcccda43409673d99af45d4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733f39c7c95492abc827bd581ca7afa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:33:22 user nova-compute[74421]: INFO nova.virt.block_device [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Booting with volume-backed-image 8df87536-9d51-4582-bc16-f205abcf2ad4 at /dev/vda
Oct 23 15:33:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:33:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Successfully created port: 06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Successfully updated port: 06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.compute.manager [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-changed-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.compute.manager [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Refreshing instance network info cache due to event network-changed-06515616-6772-42e4-be50-62701e4b4fcb. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] Acquiring lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating instance_info_cache with network_info: [{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance network_info: |[{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] Acquired lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:33:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Refreshing network info cache for port 06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:33:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updated VIF entry in instance network info cache for port 06515616-6772-42e4-be50-62701e4b4fcb. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:33:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating instance_info_cache with network_info: [{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7ce4efdb-61b8-4c7f-9676-0234c8f11009 req-0203bbdd-cd7d-4ae5-a29d-fd93cbd0443e service nova] Releasing lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:33:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:28 user nova-compute[74421]: INFO nova.compute.manager [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Terminating instance
Oct 23 15:33:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-f6d23f62-bbfa-426e-933b-d973f09927b4 req-e3ebde18-cfea-4e7f-90fc-aa55ea5d4d40 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-vif-unplugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f6d23f62-bbfa-426e-933b-d973f09927b4 req-e3ebde18-cfea-4e7f-90fc-aa55ea5d4d40 service nova] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f6d23f62-bbfa-426e-933b-d973f09927b4 req-e3ebde18-cfea-4e7f-90fc-aa55ea5d4d40 service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f6d23f62-bbfa-426e-933b-d973f09927b4 req-e3ebde18-cfea-4e7f-90fc-aa55ea5d4d40 service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-f6d23f62-bbfa-426e-933b-d973f09927b4 req-e3ebde18-cfea-4e7f-90fc-aa55ea5d4d40 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] No waiting events found dispatching network-vif-unplugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-f6d23f62-bbfa-426e-933b-d973f09927b4 req-e3ebde18-cfea-4e7f-90fc-aa55ea5d4d40 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-vif-unplugged-a15077ef-9a7b-4306-b4df-5372bc63876e for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Instance destroyed successfully.
Oct 23 15:33:29 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lazy-loading 'resources' on Instance uuid ef24f4fa-32df-438e-bb56-ee4a0b32770c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1916891573',display_name='tempest-VolumesAdminNegativeTest-server-1916891573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1916891573',id=17,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKalKZ1NBBEKeOW8MEpwEcMgFoa4H0aPCCYuEwjw1GAIVDXMehIaRqfQAsMTlVxtZt4P8FHgdmoOc50CIKU/weyTXCaarqCuYNGS5azQ3Ycf54vBNAB4EFdfsi293z6zxg==',key_name='tempest-keypair-157743316',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdf1350aabad4540a2afb76a166a3a0e',ramdisk_id='',reservation_id='r-9so2wfuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1598499002',owner_user_name='tempest-VolumesAdminNegativeTest-1598499002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfeb2fd3197444f89abc351a2ac1dfa6',uuid=ef24f4fa-32df-438e-bb56-ee4a0b32770c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converting VIF {"id": "a15077ef-9a7b-4306-b4df-5372bc63876e", "address": "fa:16:3e:ca:4c:2a", "network": {"id": "c1cf39a1-e437-4998-b587-5703d3e28bab", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-846426415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf1350aabad4540a2afb76a166a3a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15077ef-9a", "ovs_interfaceid": "a15077ef-9a7b-4306-b4df-5372bc63876e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG os_vif [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa15077ef-9a, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c1ef0cb-b1f5-4e63-9087-af01fd737e4f) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:33:29 user nova-compute[74421]: INFO os_vif [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4c:2a,bridge_name='br-int',has_traffic_filtering=True,id=a15077ef-9a7b-4306-b4df-5372bc63876e,network=Network(c1cf39a1-e437-4998-b587-5703d3e28bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15077ef-9a')
Oct 23 15:33:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Deleting instance files /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c_del
Oct 23 15:33:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Deletion of /opt/stack/data/nova/instances/ef24f4fa-32df-438e-bb56-ee4a0b32770c_del complete
Oct 23 15:33:29 user nova-compute[74421]: INFO nova.compute.manager [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 23 15:33:29 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:33:29 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:30 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Took 0.94 seconds to deallocate network for instance.
Oct 23 15:33:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-7b5699f8-ae03-4298-a2a4-701c646732cd req-5d5ec8f0-027b-4b00-91be-97ba2edd21eb service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-vif-deleted-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:33:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:30 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Deleted allocations for instance ef24f4fa-32df-438e-bb56-ee4a0b32770c
Oct 23 15:33:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ecba639e-13c3-49b3-8eed-cda038c15d6c tempest-VolumesAdminNegativeTest-1598499002 tempest-VolumesAdminNegativeTest-1598499002-project-member] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.522s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-00e382b6-58b4-45ac-8ed7-5bf31c6cc586 req-baad90ba-df1f-4e1a-bbc8-1a3bc6d8fcc7 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received event network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-00e382b6-58b4-45ac-8ed7-5bf31c6cc586 req-baad90ba-df1f-4e1a-bbc8-1a3bc6d8fcc7 service nova] Acquiring lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-00e382b6-58b4-45ac-8ed7-5bf31c6cc586 req-baad90ba-df1f-4e1a-bbc8-1a3bc6d8fcc7 service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-00e382b6-58b4-45ac-8ed7-5bf31c6cc586 req-baad90ba-df1f-4e1a-bbc8-1a3bc6d8fcc7 service nova] Lock "ef24f4fa-32df-438e-bb56-ee4a0b32770c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-00e382b6-58b4-45ac-8ed7-5bf31c6cc586 req-baad90ba-df1f-4e1a-bbc8-1a3bc6d8fcc7 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] No waiting events found dispatching network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:31 user nova-compute[74421]: WARNING nova.compute.manager [req-00e382b6-58b4-45ac-8ed7-5bf31c6cc586 req-baad90ba-df1f-4e1a-bbc8-1a3bc6d8fcc7 service nova] [instance: ef24f4fa-32df-438e-bb56-ee4a0b32770c] Received unexpected event network-vif-plugged-a15077ef-9a7b-4306-b4df-5372bc63876e for instance with vm_state deleted and task_state None.
Oct 23 15:33:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:37 user nova-compute[74421]: INFO nova.compute.manager [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Rescuing
Oct 23 15:33:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:33:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:33:37 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-d51f085b-7ec0-49b4-aab3-cbf916cd66d4 req-96488054-51af-4032-8bb1-5cd836a7822d service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d51f085b-7ec0-49b4-aab3-cbf916cd66d4 req-96488054-51af-4032-8bb1-5cd836a7822d service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d51f085b-7ec0-49b4-aab3-cbf916cd66d4 req-96488054-51af-4032-8bb1-5cd836a7822d service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d51f085b-7ec0-49b4-aab3-cbf916cd66d4 req-96488054-51af-4032-8bb1-5cd836a7822d service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-d51f085b-7ec0-49b4-aab3-cbf916cd66d4 req-96488054-51af-4032-8bb1-5cd836a7822d service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:38 user nova-compute[74421]: WARNING nova.compute.manager [req-d51f085b-7ec0-49b4-aab3-cbf916cd66d4 req-96488054-51af-4032-8bb1-5cd836a7822d service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state active and task_state rescuing.
Oct 23 15:33:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG os_brick.utils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e091d1-aee8-4fb5-b28f-93f7ffc63a92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e26b107-3657-4fda-9edc-93498ad2a2d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance destroyed successfully.
Oct 23 15:33:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Attempting rescue
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74421) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[53021528-d74c-412e-94cd-ab4eea9a5a2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1486186a-d446-48f3-936c-108e9dc5614f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:33:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Creating image(s)
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:33:39 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af502ed-7f7c-4a50-8656-874921baa0b5]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG os_brick.utils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating existing volume attachment record: 0c9e1838-83bd-4104-a5d0-5e5cd45d4c00 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue" returned: 0 in 0.069s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'migration_context' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.base [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Start _get_guest_xml network_info=[{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:22:e3:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'resources' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.base [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'numa_topology' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.base [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:33:39 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:39 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.base [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2013166828',display_name='tempest-ServerRescueNegativeTestJSON-server-2013166828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2013166828',id=20,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:29:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-ealwh0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:29:01Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:22:e3:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:22:e3:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'pci_devices' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.objects.base [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:33:39 user nova-compute[74421]:   <uuid>b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72</uuid>
Oct 23 15:33:39 user nova-compute[74421]:   <name>instance-00000014</name>
Oct 23 15:33:39 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:33:39 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:33:39 user nova-compute[74421]:   <metadata>
Oct 23 15:33:39 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:33:39 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:33:39 user nova-compute[74421]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2013166828</nova:name>
Oct 23 15:33:39 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:33:39</nova:creationTime>
Oct 23 15:33:39 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:33:39 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:33:39 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:33:39 user nova-compute[74421]:       <nova:owner>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:user uuid="6b5629aa90fa4b40b4886cb46dc21e65">tempest-ServerRescueNegativeTestJSON-1858635885-project-member</nova:user>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:project uuid="db8ed209b95549e8a0d77ead103b1c1a">tempest-ServerRescueNegativeTestJSON-1858635885</nova:project>
Oct 23 15:33:39 user nova-compute[74421]:       </nova:owner>
Oct 23 15:33:39 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:33:39 user nova-compute[74421]:       <nova:ports>
Oct 23 15:33:39 user nova-compute[74421]:         <nova:port uuid="fa74a98c-d6f5-4ce5-8a5f-343dc7372e76">
Oct 23 15:33:39 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 15:33:39 user nova-compute[74421]:         </nova:port>
Oct 23 15:33:39 user nova-compute[74421]:       </nova:ports>
Oct 23 15:33:39 user nova-compute[74421]:     </nova:instance>
Oct 23 15:33:39 user nova-compute[74421]:   </metadata>
Oct 23 15:33:39 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:33:39 user nova-compute[74421]:     <system>
Oct 23 15:33:39 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:33:39 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:33:39 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:33:39 user nova-compute[74421]:       <entry name="serial">b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72</entry>
Oct 23 15:33:39 user nova-compute[74421]:       <entry name="uuid">b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72</entry>
Oct 23 15:33:39 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:33:39 user nova-compute[74421]:     </system>
Oct 23 15:33:39 user nova-compute[74421]:   </sysinfo>
Oct 23 15:33:39 user nova-compute[74421]:   <os>
Oct 23 15:33:39 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:33:39 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:33:39 user nova-compute[74421]:   </os>
Oct 23 15:33:39 user nova-compute[74421]:   <features>
Oct 23 15:33:39 user nova-compute[74421]:     <acpi/>
Oct 23 15:33:39 user nova-compute[74421]:     <apic/>
Oct 23 15:33:39 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:33:39 user nova-compute[74421]:   </features>
Oct 23 15:33:39 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:33:39 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:33:39 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:33:39 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:33:39 user nova-compute[74421]:   </clock>
Oct 23 15:33:39 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:33:39 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:33:39 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:33:39 user nova-compute[74421]:   </cpu>
Oct 23 15:33:39 user nova-compute[74421]:   <devices>
Oct 23 15:33:39 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:33:39 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:33:39 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue"/>
Oct 23 15:33:39 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:33:39 user nova-compute[74421]:     </disk>
Oct 23 15:33:39 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:33:39 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:33:39 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk"/>
Oct 23 15:33:39 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:33:39 user nova-compute[74421]:     </disk>
Oct 23 15:33:39 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:33:39 user nova-compute[74421]:       <mac address="fa:16:3e:22:e3:17"/>
Oct 23 15:33:39 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:33:39 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:33:39 user nova-compute[74421]:       <target dev="tapfa74a98c-d6"/>
Oct 23 15:33:39 user nova-compute[74421]:     </interface>
Oct 23 15:33:39 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:33:39 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/console.log" append="off"/>
Oct 23 15:33:39 user nova-compute[74421]:     </serial>
Oct 23 15:33:39 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:33:39 user nova-compute[74421]:     <video>
Oct 23 15:33:39 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:33:39 user nova-compute[74421]:     </video>
Oct 23 15:33:39 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:33:39 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:33:39 user nova-compute[74421]:     </rng>
Oct 23 15:33:39 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:33:39 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:33:39 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:33:39 user nova-compute[74421]:     </memballoon>
Oct 23 15:33:39 user nova-compute[74421]:   </devices>
Oct 23 15:33:39 user nova-compute[74421]: </domain>
Oct 23 15:33:39 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:33:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance destroyed successfully.
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:33:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:22:e3:17, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-1c319271-2069-4e7e-9d79-51177fe1c710 req-78163ccc-ba73-42d3-b19e-c928fab71c74 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1c319271-2069-4e7e-9d79-51177fe1c710 req-78163ccc-ba73-42d3-b19e-c928fab71c74 service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1c319271-2069-4e7e-9d79-51177fe1c710 req-78163ccc-ba73-42d3-b19e-c928fab71c74 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1c319271-2069-4e7e-9d79-51177fe1c710 req-78163ccc-ba73-42d3-b19e-c928fab71c74 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-1c319271-2069-4e7e-9d79-51177fe1c710 req-78163ccc-ba73-42d3-b19e-c928fab71c74 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:40 user nova-compute[74421]: WARNING nova.compute.manager [req-1c319271-2069-4e7e-9d79-51177fe1c710 req-78163ccc-ba73-42d3-b19e-c928fab71c74 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state active and task_state rescuing.
Oct 23 15:33:40 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:33:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:42 user nova-compute[74421]: WARNING nova.compute.manager [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state active and task_state rescuing.
Oct 23 15:33:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:33:42 user nova-compute[74421]: WARNING nova.compute.manager [req-434788ac-ef3b-4759-85ac-b07364db0129 req-99199bbf-2353-4c32-8d46-430c6efa21ee service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state active and task_state rescuing.
Oct 23 15:33:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6f9de540-d522-40c9-a95d-194663f388af tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:33:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:33:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7885MB free_disk=25.165996551513672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:33:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:33:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:33:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:33:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Creating image(s)
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Ensure instance console log exists: /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Start _get_guest_xml network_info=[{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '0c9e1838-83bd-4104-a5d0-5e5cd45d4c00', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1ad1db4-d19c-42d6-a7af-3296b6c7c461', 'attached_at': '', 'detached_at': '', 'volume_id': '6ec12c5b-6363-4442-8b4e-f949e29d8067', 'serial': '6ec12c5b-6363-4442-8b4e-f949e29d8067'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:33:59 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:59 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:33:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:33:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:33:59 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[50641976-d296-477a-98d2-16422c132e6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:33:59 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1904aa1-9e37-4a3f-a46d-1187c61764fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067] added
Oct 23 15:33:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc38fb-9137-47cf-a042-68e828e9ac50]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c97cf39-8982-499f-8f37-be48daab864d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftuNHOrz {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftuNHOrz" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281759e-ab6a-44c9-986f-78885d4624bf]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftuNHOrz'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f87c1b-861f-4074-bc15-fd7d26f5ccf2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa09404c-3fbf-4ec1-808b-94d634c9b36c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:33:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:33:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc168b-940e-4cd0-8fd9-de481fa9f990]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260]
Oct 23 15:33:59 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260] successful.
Oct 23 15:33:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef04db7d-72da-442c-9b39-ee292e6882bc]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5313702-95c2-46cf-9cd0-53405f635fdf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:33:59 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:33:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:33:59 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:33:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c6fbf-2651-412a-960b-126cc108dbe4]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:33:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:34:00 user nova-compute[74421]: INFO nova.compute.claims [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Claim successful on node user
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23839396361663165', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839396361663165', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1964539500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1964539500',id=30,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-4z2qr04e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:33:23Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=d1ad1db4-d19c-42d6-a7af-3296b6c7c461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.objects.instance [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'pci_devices' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:34:00 user nova-compute[74421]:   <uuid>d1ad1db4-d19c-42d6-a7af-3296b6c7c461</uuid>
Oct 23 15:34:00 user nova-compute[74421]:   <name>instance-0000001e</name>
Oct 23 15:34:00 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:34:00 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:34:00 user nova-compute[74421]:   <metadata>
Oct 23 15:34:00 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:34:00 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:34:00 user nova-compute[74421]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1964539500</nova:name>
Oct 23 15:34:00 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:33:59</nova:creationTime>
Oct 23 15:34:00 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:34:00 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:34:00 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:34:00 user nova-compute[74421]:       <nova:owner>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:user uuid="166776dcccda43409673d99af45d4390">tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member</nova:user>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:project uuid="f733f39c7c95492abc827bd581ca7afa">tempest-ServerBootFromVolumeStableRescueTest-2014752681</nova:project>
Oct 23 15:34:00 user nova-compute[74421]:       </nova:owner>
Oct 23 15:34:00 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:34:00 user nova-compute[74421]:       <nova:ports>
Oct 23 15:34:00 user nova-compute[74421]:         <nova:port uuid="06515616-6772-42e4-be50-62701e4b4fcb">
Oct 23 15:34:00 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 15:34:00 user nova-compute[74421]:         </nova:port>
Oct 23 15:34:00 user nova-compute[74421]:       </nova:ports>
Oct 23 15:34:00 user nova-compute[74421]:     </nova:instance>
Oct 23 15:34:00 user nova-compute[74421]:   </metadata>
Oct 23 15:34:00 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:34:00 user nova-compute[74421]:     <system>
Oct 23 15:34:00 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:34:00 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:34:00 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:34:00 user nova-compute[74421]:       <entry name="serial">d1ad1db4-d19c-42d6-a7af-3296b6c7c461</entry>
Oct 23 15:34:00 user nova-compute[74421]:       <entry name="uuid">d1ad1db4-d19c-42d6-a7af-3296b6c7c461</entry>
Oct 23 15:34:00 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:34:00 user nova-compute[74421]:     </system>
Oct 23 15:34:00 user nova-compute[74421]:   </sysinfo>
Oct 23 15:34:00 user nova-compute[74421]:   <os>
Oct 23 15:34:00 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:34:00 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:34:00 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:34:00 user nova-compute[74421]:   </os>
Oct 23 15:34:00 user nova-compute[74421]:   <features>
Oct 23 15:34:00 user nova-compute[74421]:     <acpi/>
Oct 23 15:34:00 user nova-compute[74421]:     <apic/>
Oct 23 15:34:00 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:34:00 user nova-compute[74421]:   </features>
Oct 23 15:34:00 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:34:00 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:34:00 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:34:00 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:34:00 user nova-compute[74421]:   </clock>
Oct 23 15:34:00 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:34:00 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:34:00 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:34:00 user nova-compute[74421]:   </cpu>
Oct 23 15:34:00 user nova-compute[74421]:   <devices>
Oct 23 15:34:00 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:34:00 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:34:00 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:34:00 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:34:00 user nova-compute[74421]:       <serial>6ec12c5b-6363-4442-8b4e-f949e29d8067</serial>
Oct 23 15:34:00 user nova-compute[74421]:     </disk>
Oct 23 15:34:00 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:34:00 user nova-compute[74421]:       <mac address="fa:16:3e:a9:55:c5"/>
Oct 23 15:34:00 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:34:00 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:34:00 user nova-compute[74421]:       <target dev="tap06515616-67"/>
Oct 23 15:34:00 user nova-compute[74421]:     </interface>
Oct 23 15:34:00 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:34:00 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/console.log" append="off"/>
Oct 23 15:34:00 user nova-compute[74421]:     </serial>
Oct 23 15:34:00 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:34:00 user nova-compute[74421]:     <video>
Oct 23 15:34:00 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:34:00 user nova-compute[74421]:     </video>
Oct 23 15:34:00 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:34:00 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:34:00 user nova-compute[74421]:     </rng>
Oct 23 15:34:00 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:34:00 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:34:00 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:34:00 user nova-compute[74421]:     </memballoon>
Oct 23 15:34:00 user nova-compute[74421]:   </devices>
Oct 23 15:34:00 user nova-compute[74421]: </domain>
Oct 23 15:34:00 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1964539500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1964539500',id=30,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-4z2qr04e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:33:23Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=d1ad1db4-d19c-42d6-a7af-3296b6c7c461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG os_vif [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '747abf5a-054e-50d4-a68a-c0756afc547b', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06515616-67, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06515616-67, col_values=(('qos', UUID('c177bde0-03a2-488d-a97f-db6a31ce7e72')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06515616-67, col_values=(('external_ids', {'iface-id': '06515616-6772-42e4-be50-62701e4b4fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:55:c5', 'vm-uuid': 'd1ad1db4-d19c-42d6-a7af-3296b6c7c461'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:00 user nova-compute[74421]: INFO os_vif [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67')
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No VIF found with MAC fa:16:3e:a9:55:c5, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.network.neutron [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:34:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:34:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:34:00 user nova-compute[74421]: INFO nova.virt.block_device [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Booting with volume 530d2ac0-ffa9-453e-8c0d-9b292e1ec395 at /dev/vda
Oct 23 15:34:01 user nova-compute[74421]: DEBUG nova.policy [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182146bec4cf473ab9e025bca5a74371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0053dc54a1e44f18966d687a2bb42e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG os_brick.utils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d46542-90de-49dc-89a6-a29187cf51e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8f981-f208-4c16-ba9e-7a14adb94129]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea105ff-180c-4af9-8fbe-3441d1d88bcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f00f190-31b9-415d-8945-5a001614e5a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:34:01 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c1128-15b3-4e84-8188-4976cc7f36c6]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG os_brick.utils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating existing volume attachment record: d08eaad8-a328-49c2-8ac6-5b94ee33b4b3 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-changed-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing instance network info cache due to event network-changed-3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG nova.network.neutron [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing network info cache for port 3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:34:01 user nova-compute[74421]: DEBUG nova.network.neutron [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Successfully created port: 97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG nova.network.neutron [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updated VIF entry in instance network info cache for port 3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG nova.network.neutron [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ab52ea51-d66c-44cc-8d52-2c49b546c373 req-d957fc47-fb63-4074-8c9e-b8810a64abf3 service nova] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-06f43a41-969a-44a2-89a1-deb5c5169330 req-b7bbcb3e-cb96-4553-8e14-32dc2b26d149 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-06f43a41-969a-44a2-89a1-deb5c5169330 req-b7bbcb3e-cb96-4553-8e14-32dc2b26d149 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-06f43a41-969a-44a2-89a1-deb5c5169330 req-b7bbcb3e-cb96-4553-8e14-32dc2b26d149 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-06f43a41-969a-44a2-89a1-deb5c5169330 req-b7bbcb3e-cb96-4553-8e14-32dc2b26d149 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-06f43a41-969a-44a2-89a1-deb5c5169330 req-b7bbcb3e-cb96-4553-8e14-32dc2b26d149 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:02 user nova-compute[74421]: WARNING nova.compute.manager [req-06f43a41-969a-44a2-89a1-deb5c5169330 req-b7bbcb3e-cb96-4553-8e14-32dc2b26d149 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state building and task_state spawning.
Oct 23 15:34:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Successfully updated port: 97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquired lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Releasing lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance network_info: |[{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:34:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance spawned successfully.
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-changed-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Refreshing instance network info cache due to event network-changed-97945e10-06c5-453a-9e05-359a5b48ae0b. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] Acquiring lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] Acquired lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Refreshing network info cache for port 97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:04 user nova-compute[74421]: INFO nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Took 5.85 seconds to spawn the instance on the hypervisor.
Oct 23 15:34:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:34:05 user nova-compute[74421]: INFO nova.compute.manager [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Took 42.81 seconds to build instance.
Oct 23 15:34:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fcbec9ae-fa23-42fe-a0ad-2f983207faac tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.943s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updated VIF entry in instance network info cache for port 97945e10-06c5-453a-9e05-359a5b48ae0b. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG nova.network.neutron [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] Releasing lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:05 user nova-compute[74421]: WARNING nova.compute.manager [req-b38f4484-097e-4784-8fd8-0f16337b8919 req-16b0c75c-f735-44ff-a16e-6eff21c2ae99 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state building and task_state spawning.
Oct 23 15:34:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:09 user nova-compute[74421]: INFO nova.compute.manager [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Shelving
Oct 23 15:34:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-1e1f989b-5c48-486d-a90e-7d6636d022bf req-756db5e0-8515-4c61-9815-202c2bde8e05 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-unplugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1e1f989b-5c48-486d-a90e-7d6636d022bf req-756db5e0-8515-4c61-9815-202c2bde8e05 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1e1f989b-5c48-486d-a90e-7d6636d022bf req-756db5e0-8515-4c61-9815-202c2bde8e05 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1e1f989b-5c48-486d-a90e-7d6636d022bf req-756db5e0-8515-4c61-9815-202c2bde8e05 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-1e1f989b-5c48-486d-a90e-7d6636d022bf req-756db5e0-8515-4c61-9815-202c2bde8e05 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-unplugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:09 user nova-compute[74421]: WARNING nova.compute.manager [req-1e1f989b-5c48-486d-a90e-7d6636d022bf req-756db5e0-8515-4c61-9815-202c2bde8e05 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-unplugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state active and task_state shelving.
Oct 23 15:34:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance destroyed successfully.
Oct 23 15:34:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Beginning cold snapshot process
Oct 23 15:34:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:10 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:34:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk /opt/stack/data/nova/instances/snapshots/tmplemapbgt/f2b4ae9d14d9438db13df279639435db {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk /opt/stack/data/nova/instances/snapshots/tmplemapbgt/f2b4ae9d14d9438db13df279639435db" returned: 0 in 1.111s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:11 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Snapshot extracted, beginning image upload
Oct 23 15:34:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-7c10efbe-b7fe-4ca4-9713-95b66a76e781 req-6e15ebde-1f76-4c00-a0eb-be5e8f34dd62 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7c10efbe-b7fe-4ca4-9713-95b66a76e781 req-6e15ebde-1f76-4c00-a0eb-be5e8f34dd62 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7c10efbe-b7fe-4ca4-9713-95b66a76e781 req-6e15ebde-1f76-4c00-a0eb-be5e8f34dd62 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7c10efbe-b7fe-4ca4-9713-95b66a76e781 req-6e15ebde-1f76-4c00-a0eb-be5e8f34dd62 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-7c10efbe-b7fe-4ca4-9713-95b66a76e781 req-6e15ebde-1f76-4c00-a0eb-be5e8f34dd62 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:11 user nova-compute[74421]: WARNING nova.compute.manager [req-7c10efbe-b7fe-4ca4-9713-95b66a76e781 req-6e15ebde-1f76-4c00-a0eb-be5e8f34dd62 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 15:34:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Snapshot image upload complete
Oct 23 15:34:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:34:15 user nova-compute[74421]: INFO nova.compute.manager [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Shelve offloading
Oct 23 15:34:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance destroyed successfully.
Oct 23 15:34:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG nova.network.neutron [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG nova.network.neutron [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance destroyed successfully.
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.objects.instance [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'resources' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-571678447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-571678447',id=28,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeDIxepctcSrFTcbLK/ccp3FKUQ7tG5yVqw4T3D9JpBAK4oJeTw5kVYD2cdrIdKMrjqMaMOt+5F1VSgudkgXPH5is6aIjzJnOJfumdleq7j7KKqSkfP14pZg+YGcSPNkw==',key_name='tempest-keypair-91007934',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:32:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-yqousym9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member',shelved_at='2023-10-23T15:34:14.964613',shelved_host='user',shelved_image_id='d8dab8c6-c3b2-4438-a5c0-c239cc3dc059'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=a43d4143-17b5-4a95-8e03-3c47568ba3e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG os_vif [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3275c793-60, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8305ab5-cab9-4efd-92bf-32eb76774997) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:16 user nova-compute[74421]: INFO os_vif [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60')
Oct 23 15:34:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Deleting instance files /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2_del
Oct 23 15:34:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Deletion of /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2_del complete
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-changed-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing instance network info cache due to event network-changed-3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.network.neutron [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing network info cache for port 3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:34:16 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Deleted allocations for instance a43d4143-17b5-4a95-8e03-3c47568ba3e2
Oct 23 15:34:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.objects.instance [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'numa_topology' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:34:16 user nova-compute[74421]: DEBUG nova.objects.base [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<a43d4143-17b5-4a95-8e03-3c47568ba3e2> lazy-loaded attributes: resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG nova.network.neutron [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updated VIF entry in instance network info cache for port 3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG nova.network.neutron [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3275c793-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e9f87b67-674c-4e00-931e-4c8307ddf371 req-b662e08b-1023-42bf-9b03-be2ca293d9e0 service nova] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-150614cd-a39e-40f4-a883-283adab78707 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.379s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:34:25 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Creating image(s)
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Ensure instance console log exists: /opt/stack/data/nova/instances/71f11170-4d47-419e-a067-dbc82352a8b9/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Start _get_guest_xml network_info=[{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'd08eaad8-a328-49c2-8ac6-5b94ee33b4b3', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71f11170-4d47-419e-a067-dbc82352a8b9', 'attached_at': '', 'detached_at': '', 'volume_id': '530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'serial': '530d2ac0-ffa9-453e-8c0d-9b292e1ec395'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:34:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:34:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:34:25 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:34:25 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:34:25 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[833fd681-589f-4b1a-a262-76e79d4f94c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:34:25 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7f7c79-4d7e-4ba2-8122-4aa489664d80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395] added
Oct 23 15:34:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fdfa75-c94f-461a-9461-7361b7ab3964]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2a91e-0a37-49fd-8328-2a6d82686f58]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMpidyGO {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMpidyGO" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57097e82-4a3b-433d-92db-a40482ed077e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMpidyGO'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ce4576-eefa-4983-8b2c-7cd339b53193]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[49acb9d5-8cd5-49f9-a0d6-57cf053dce06]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a351fd29-8588-433f-b651-2cbe4ab102fe (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a351fd29-8588-433f-b651-2cbe4ab102fe (non-flash)
Oct 23 15:34:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a351fd29-8588-433f-b651-2cbe4ab102fe (non-flash)
Oct 23 15:34:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb4a04-ee0c-449a-9a88-afa306562112]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]
Oct 23 15:34:25 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.
Oct 23 15:34:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b1e0bd-a71c-4567-bb69-912995c0fe51]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[02449e53-c674-4f69-9248-c3b8173c6b1c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a351fd29-8588-433f-b651-2cbe4ab102fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a351fd29-8588-433f-b651-2cbe4ab102fe (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a351fd29-8588-433f-b651-2cbe4ab102fe (non-flash)
Oct 23 15:34:25 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:34:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc86b12-ba40-4309-8658-5c8f388eb7b8]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:34:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '23234633964653566', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234633964653566', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323723003',display_name='tempest-ServerActionsTestOtherA-server-1323723003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323723003',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-9v52yphd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=71f11170-4d47-419e-a067-dbc82352a8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.objects.instance [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'pci_devices' on Instance uuid 71f11170-4d47-419e-a067-dbc82352a8b9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:34:26 user nova-compute[74421]:   <uuid>71f11170-4d47-419e-a067-dbc82352a8b9</uuid>
Oct 23 15:34:26 user nova-compute[74421]:   <name>instance-0000001f</name>
Oct 23 15:34:26 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:34:26 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:34:26 user nova-compute[74421]:   <metadata>
Oct 23 15:34:26 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:34:26 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:34:26 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherA-server-1323723003</nova:name>
Oct 23 15:34:26 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:34:25</nova:creationTime>
Oct 23 15:34:26 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:34:26 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:34:26 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:34:26 user nova-compute[74421]:       <nova:owner>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:user uuid="182146bec4cf473ab9e025bca5a74371">tempest-ServerActionsTestOtherA-369604222-project-member</nova:user>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:project uuid="d0053dc54a1e44f18966d687a2bb42e4">tempest-ServerActionsTestOtherA-369604222</nova:project>
Oct 23 15:34:26 user nova-compute[74421]:       </nova:owner>
Oct 23 15:34:26 user nova-compute[74421]:       <nova:ports>
Oct 23 15:34:26 user nova-compute[74421]:         <nova:port uuid="97945e10-06c5-453a-9e05-359a5b48ae0b">
Oct 23 15:34:26 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:34:26 user nova-compute[74421]:         </nova:port>
Oct 23 15:34:26 user nova-compute[74421]:       </nova:ports>
Oct 23 15:34:26 user nova-compute[74421]:     </nova:instance>
Oct 23 15:34:26 user nova-compute[74421]:   </metadata>
Oct 23 15:34:26 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:34:26 user nova-compute[74421]:     <system>
Oct 23 15:34:26 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:34:26 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:34:26 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:34:26 user nova-compute[74421]:       <entry name="serial">71f11170-4d47-419e-a067-dbc82352a8b9</entry>
Oct 23 15:34:26 user nova-compute[74421]:       <entry name="uuid">71f11170-4d47-419e-a067-dbc82352a8b9</entry>
Oct 23 15:34:26 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:34:26 user nova-compute[74421]:     </system>
Oct 23 15:34:26 user nova-compute[74421]:   </sysinfo>
Oct 23 15:34:26 user nova-compute[74421]:   <os>
Oct 23 15:34:26 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:34:26 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:34:26 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:34:26 user nova-compute[74421]:   </os>
Oct 23 15:34:26 user nova-compute[74421]:   <features>
Oct 23 15:34:26 user nova-compute[74421]:     <acpi/>
Oct 23 15:34:26 user nova-compute[74421]:     <apic/>
Oct 23 15:34:26 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:34:26 user nova-compute[74421]:   </features>
Oct 23 15:34:26 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:34:26 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:34:26 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:34:26 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:34:26 user nova-compute[74421]:   </clock>
Oct 23 15:34:26 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:34:26 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:34:26 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:34:26 user nova-compute[74421]:   </cpu>
Oct 23 15:34:26 user nova-compute[74421]:   <devices>
Oct 23 15:34:26 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:34:26 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:34:26 user nova-compute[74421]:       <source dev="/dev/sdd"/>
Oct 23 15:34:26 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:34:26 user nova-compute[74421]:       <serial>530d2ac0-ffa9-453e-8c0d-9b292e1ec395</serial>
Oct 23 15:34:26 user nova-compute[74421]:     </disk>
Oct 23 15:34:26 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:34:26 user nova-compute[74421]:       <mac address="fa:16:3e:88:b3:1d"/>
Oct 23 15:34:26 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:34:26 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:34:26 user nova-compute[74421]:       <target dev="tap97945e10-06"/>
Oct 23 15:34:26 user nova-compute[74421]:     </interface>
Oct 23 15:34:26 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:34:26 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/71f11170-4d47-419e-a067-dbc82352a8b9/console.log" append="off"/>
Oct 23 15:34:26 user nova-compute[74421]:     </serial>
Oct 23 15:34:26 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:34:26 user nova-compute[74421]:     <video>
Oct 23 15:34:26 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:34:26 user nova-compute[74421]:     </video>
Oct 23 15:34:26 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:34:26 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:34:26 user nova-compute[74421]:     </rng>
Oct 23 15:34:26 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:34:26 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:34:26 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:34:26 user nova-compute[74421]:     </memballoon>
Oct 23 15:34:26 user nova-compute[74421]:   </devices>
Oct 23 15:34:26 user nova-compute[74421]: </domain>
Oct 23 15:34:26 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323723003',display_name='tempest-ServerActionsTestOtherA-server-1323723003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323723003',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-9v52yphd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=71f11170-4d47-419e-a067-dbc82352a8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG os_vif [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4249902b-0bf3-5e0c-a685-d78bdfca93fb', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97945e10-06, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97945e10-06, col_values=(('qos', UUID('86dc398f-af0d-4f93-86bc-8c117b56cca0')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97945e10-06, col_values=(('external_ids', {'iface-id': '97945e10-06c5-453a-9e05-359a5b48ae0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b3:1d', 'vm-uuid': '71f11170-4d47-419e-a067-dbc82352a8b9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:26 user nova-compute[74421]: INFO os_vif [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06')
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:34:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No VIF found with MAC fa:16:3e:88:b3:1d, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:34:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-e7cecf4b-8570-480c-a5ca-fe488ed27abf req-bbd8dabf-9027-4c9f-b74d-aa9d114bc9fa service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e7cecf4b-8570-480c-a5ca-fe488ed27abf req-bbd8dabf-9027-4c9f-b74d-aa9d114bc9fa service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e7cecf4b-8570-480c-a5ca-fe488ed27abf req-bbd8dabf-9027-4c9f-b74d-aa9d114bc9fa service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e7cecf4b-8570-480c-a5ca-fe488ed27abf req-bbd8dabf-9027-4c9f-b74d-aa9d114bc9fa service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-e7cecf4b-8570-480c-a5ca-fe488ed27abf req-bbd8dabf-9027-4c9f-b74d-aa9d114bc9fa service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:28 user nova-compute[74421]: WARNING nova.compute.manager [req-e7cecf4b-8570-480c-a5ca-fe488ed27abf req-bbd8dabf-9027-4c9f-b74d-aa9d114bc9fa service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state building and task_state spawning.
Oct 23 15:34:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-d6d36f1e-1a68-4181-a7a8-44cfd6ebb906 req-611bff2a-1b43-4fef-9c59-06adcaf10a6e service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d6d36f1e-1a68-4181-a7a8-44cfd6ebb906 req-611bff2a-1b43-4fef-9c59-06adcaf10a6e service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d6d36f1e-1a68-4181-a7a8-44cfd6ebb906 req-611bff2a-1b43-4fef-9c59-06adcaf10a6e service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d6d36f1e-1a68-4181-a7a8-44cfd6ebb906 req-611bff2a-1b43-4fef-9c59-06adcaf10a6e service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-d6d36f1e-1a68-4181-a7a8-44cfd6ebb906 req-611bff2a-1b43-4fef-9c59-06adcaf10a6e service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:30 user nova-compute[74421]: WARNING nova.compute.manager [req-d6d36f1e-1a68-4181-a7a8-44cfd6ebb906 req-611bff2a-1b43-4fef-9c59-06adcaf10a6e service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state building and task_state spawning.
Oct 23 15:34:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:34:33 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance spawned successfully.
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:34 user nova-compute[74421]: INFO nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Took 9.24 seconds to spawn the instance on the hypervisor.
Oct 23 15:34:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:34:34 user nova-compute[74421]: INFO nova.compute.manager [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Took 34.63 seconds to build instance.
Oct 23 15:34:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50d3c9c8-fd74-4204-9a5f-6be32515f46f tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.905s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:34:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:34:43 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:43 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:34:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:45 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:34:48 user nova-compute[74421]: INFO nova.compute.claims [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Claim successful on node user
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:34:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.288s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.276s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:34:49 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.policy [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48dd14495e7f4cf8b8749576587dcd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d0b7398cb46eb8679e805d97f885d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:34:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Creating image(s)
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:34:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7711MB free_disk=25.128253936767578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Successfully created port: 3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 71f11170-4d47-419e-a067-dbc82352a8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:34:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.242s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk 1073741824" returned: 0 in 0.059s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.243s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.878s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Cannot resize image /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Ensure instance console log exists: /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Successfully updated port: 3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing instance network info cache due to event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:34:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance network_info: |[{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Start _get_guest_xml network_info=[{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:34:53 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:34:53 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-421215235',display_name='tempest-ServerStableDeviceRescueTest-server-421215235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-421215235',id=32,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBvo0kVlIhhyl67IvxCbw2l4gBzHopt6ssxdLzHTEiG+m4TghLNIFCoYGZEPBE2ROJ4/vgCRLw5ObBwv1WqcT2PAO0jtPBiAyYOJIvlFS999aFAy4jfuCRX5i50Vi9tqg==',key_name='tempest-keypair-1702398332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c0d0b7398cb46eb8679e805d97f885d',ramdisk_id='',reservation_id='r-he732kxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1906331641',owner_user_name='tempest-ServerStableDeviceRescueTest-1906331641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dd14495e7f4cf8b8749576587dcd0f',uuid=8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converting VIF {"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:34:53 user nova-compute[74421]:   <uuid>8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3</uuid>
Oct 23 15:34:53 user nova-compute[74421]:   <name>instance-00000020</name>
Oct 23 15:34:53 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:34:53 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:34:53 user nova-compute[74421]:   <metadata>
Oct 23 15:34:53 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:34:53 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:34:53 user nova-compute[74421]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-421215235</nova:name>
Oct 23 15:34:53 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:34:53</nova:creationTime>
Oct 23 15:34:53 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:34:53 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:34:53 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:34:53 user nova-compute[74421]:       <nova:owner>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:user uuid="48dd14495e7f4cf8b8749576587dcd0f">tempest-ServerStableDeviceRescueTest-1906331641-project-member</nova:user>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:project uuid="3c0d0b7398cb46eb8679e805d97f885d">tempest-ServerStableDeviceRescueTest-1906331641</nova:project>
Oct 23 15:34:53 user nova-compute[74421]:       </nova:owner>
Oct 23 15:34:53 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:34:53 user nova-compute[74421]:       <nova:ports>
Oct 23 15:34:53 user nova-compute[74421]:         <nova:port uuid="3732d23a-cecb-4ede-b572-d105a2c3dda3">
Oct 23 15:34:53 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:34:53 user nova-compute[74421]:         </nova:port>
Oct 23 15:34:53 user nova-compute[74421]:       </nova:ports>
Oct 23 15:34:53 user nova-compute[74421]:     </nova:instance>
Oct 23 15:34:53 user nova-compute[74421]:   </metadata>
Oct 23 15:34:53 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:34:53 user nova-compute[74421]:     <system>
Oct 23 15:34:53 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:34:53 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:34:53 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:34:53 user nova-compute[74421]:       <entry name="serial">8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3</entry>
Oct 23 15:34:53 user nova-compute[74421]:       <entry name="uuid">8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3</entry>
Oct 23 15:34:53 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:34:53 user nova-compute[74421]:     </system>
Oct 23 15:34:53 user nova-compute[74421]:   </sysinfo>
Oct 23 15:34:53 user nova-compute[74421]:   <os>
Oct 23 15:34:53 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:34:53 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:34:53 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:34:53 user nova-compute[74421]:   </os>
Oct 23 15:34:53 user nova-compute[74421]:   <features>
Oct 23 15:34:53 user nova-compute[74421]:     <acpi/>
Oct 23 15:34:53 user nova-compute[74421]:     <apic/>
Oct 23 15:34:53 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:34:53 user nova-compute[74421]:   </features>
Oct 23 15:34:53 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:34:53 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:34:53 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:34:53 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:34:53 user nova-compute[74421]:   </clock>
Oct 23 15:34:53 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:34:53 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:34:53 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:34:53 user nova-compute[74421]:   </cpu>
Oct 23 15:34:53 user nova-compute[74421]:   <devices>
Oct 23 15:34:53 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:34:53 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:34:53 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk"/>
Oct 23 15:34:53 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:34:53 user nova-compute[74421]:     </disk>
Oct 23 15:34:53 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:34:53 user nova-compute[74421]:       <mac address="fa:16:3e:03:60:32"/>
Oct 23 15:34:53 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:34:53 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:34:53 user nova-compute[74421]:       <target dev="tap3732d23a-ce"/>
Oct 23 15:34:53 user nova-compute[74421]:     </interface>
Oct 23 15:34:53 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:34:53 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/console.log" append="off"/>
Oct 23 15:34:53 user nova-compute[74421]:     </serial>
Oct 23 15:34:53 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:34:53 user nova-compute[74421]:     <video>
Oct 23 15:34:53 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:34:53 user nova-compute[74421]:     </video>
Oct 23 15:34:53 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:34:53 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:34:53 user nova-compute[74421]:     </rng>
Oct 23 15:34:53 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:34:53 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:34:53 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:34:53 user nova-compute[74421]:     </memballoon>
Oct 23 15:34:53 user nova-compute[74421]:   </devices>
Oct 23 15:34:53 user nova-compute[74421]: </domain>
Oct 23 15:34:53 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-421215235',display_name='tempest-ServerStableDeviceRescueTest-server-421215235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-421215235',id=32,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBvo0kVlIhhyl67IvxCbw2l4gBzHopt6ssxdLzHTEiG+m4TghLNIFCoYGZEPBE2ROJ4/vgCRLw5ObBwv1WqcT2PAO0jtPBiAyYOJIvlFS999aFAy4jfuCRX5i50Vi9tqg==',key_name='tempest-keypair-1702398332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c0d0b7398cb46eb8679e805d97f885d',ramdisk_id='',reservation_id='r-he732kxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1906331641',owner_user_name='tempest-ServerStableDeviceRescueTest-1906331641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dd14495e7f4cf8b8749576587dcd0f',uuid=8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converting VIF {"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG os_vif [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '106b5bb2-0265-52dd-be7b-cfad4d760773', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3732d23a-ce, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3732d23a-ce, col_values=(('qos', UUID('449d35af-08ff-4950-a05e-0f070eaec486')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3732d23a-ce, col_values=(('external_ids', {'iface-id': '3732d23a-cecb-4ede-b572-d105a2c3dda3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:60:32', 'vm-uuid': '8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:53 user nova-compute[74421]: INFO os_vif [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce')
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No VIF found with MAC fa:16:3e:03:60:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updated VIF entry in instance network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-687b6e77-dd66-4c28-97f0-2d65ecf918d7 req-e44c2d39-81c4-462d-bdb2-e9e98fcbf549 service nova] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-changed-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Refreshing instance network info cache due to event network-changed-f3e9f491-f219-4b09-b93f-fd0192567eef. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] Acquiring lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] Acquired lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Refreshing network info cache for port f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG nova.network.neutron [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updated VIF entry in instance network info cache for port f3e9f491-f219-4b09-b93f-fd0192567eef. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG nova.network.neutron [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updating instance_info_cache with network_info: [{"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:34:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-528ceae2-5808-4e45-ab01-44524896abbf req-5665e1bf-062a-4478-bbdc-47c9db04de9d service nova] Releasing lock "refresh_cache-a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:56 user nova-compute[74421]: WARNING nova.compute.manager [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state building and task_state spawning.
Oct 23 15:34:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:34:56 user nova-compute[74421]: WARNING nova.compute.manager [req-ff5ae38a-339a-4ca6-8921-0c0caa995318 req-66896d4a-d688-41b0-ac5f-249ddf1c1fff service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state building and task_state spawning.
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:34:57 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance spawned successfully.
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:34:57 user nova-compute[74421]: INFO nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Took 7.42 seconds to spawn the instance on the hypervisor.
Oct 23 15:34:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:34:57 user nova-compute[74421]: INFO nova.compute.manager [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Took 8.91 seconds to build instance.
Oct 23 15:34:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f4add11d-12fc-43d4-bda5-9a9b0d934d3e tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.075s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:34:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:34:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:34:59 user nova-compute[74421]: INFO nova.compute.manager [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Attaching volume 7cc2fb13-45d8-4547-86f3-a05e69fd7b9a to /dev/vdb
Oct 23 15:34:59 user nova-compute[74421]: DEBUG os_brick.utils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f174932e-d14b-4ec5-9598-fec2205e3c1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4754f260-b6e7-4f0a-a9e6-17f25cd19792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8299d6-bbf4-4fef-a014-6546e0594532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3dec45-f1ae-4d20-b930-0a110f706316]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:34:59 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:34:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d5b8b2-3331-4838-866f-062ea0bcf208]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG os_brick.utils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:34:59 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updating existing volume attachment record: ad307309-f1a6-47b6-8fa6-777a045a1141 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:35:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:13 user nova-compute[74421]: INFO nova.compute.manager [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Rescuing
Oct 23 15:35:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:35:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating instance_info_cache with network_info: [{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-e3c6f15f-c3e6-4149-8d90-fb8695816443 req-056f9ef8-822a-44c4-b46d-f9c484d53739 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e3c6f15f-c3e6-4149-8d90-fb8695816443 req-056f9ef8-822a-44c4-b46d-f9c484d53739 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e3c6f15f-c3e6-4149-8d90-fb8695816443 req-056f9ef8-822a-44c4-b46d-f9c484d53739 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e3c6f15f-c3e6-4149-8d90-fb8695816443 req-056f9ef8-822a-44c4-b46d-f9c484d53739 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-e3c6f15f-c3e6-4149-8d90-fb8695816443 req-056f9ef8-822a-44c4-b46d-f9c484d53739 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:14 user nova-compute[74421]: WARNING nova.compute.manager [req-e3c6f15f-c3e6-4149-8d90-fb8695816443 req-056f9ef8-822a-44c4-b46d-f9c484d53739 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state active and task_state rescuing.
Oct 23 15:35:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance destroyed successfully.
Oct 23 15:35:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Attempting a stable device rescue
Oct 23 15:35:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74421) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:35:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Creating image(s)
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "/opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "1bd5405b5120a68592029f8b2247097ed8c4660a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "1bd5405b5120a68592029f8b2247097ed8c4660a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG nova.virt.images [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ce221228-def1-4cd3-bc94-e77637e87e30 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.part /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-154a80d8-76aa-494d-82a1-b1587b5ce078 req-4c85f3d6-8082-45c8-a4b4-9be18a1296c9 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-154a80d8-76aa-494d-82a1-b1587b5ce078 req-4c85f3d6-8082-45c8-a4b4-9be18a1296c9 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-154a80d8-76aa-494d-82a1-b1587b5ce078 req-4c85f3d6-8082-45c8-a4b4-9be18a1296c9 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-154a80d8-76aa-494d-82a1-b1587b5ce078 req-4c85f3d6-8082-45c8-a4b4-9be18a1296c9 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-154a80d8-76aa-494d-82a1-b1587b5ce078 req-4c85f3d6-8082-45c8-a4b4-9be18a1296c9 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:16 user nova-compute[74421]: WARNING nova.compute.manager [req-154a80d8-76aa-494d-82a1-b1587b5ce078 req-4c85f3d6-8082-45c8-a4b4-9be18a1296c9 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state active and task_state rescuing.
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.part /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.converted" returned: 0 in 0.514s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:16 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "1bd5405b5120a68592029f8b2247097ed8c4660a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.125s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "1bd5405b5120a68592029f8b2247097ed8c4660a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "1bd5405b5120a68592029f8b2247097ed8c4660a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a --force-share --output=json" returned: 0 in 0.231s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a,backing_fmt=raw /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a,backing_fmt=raw /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue" returned: 0 in 0.057s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "1bd5405b5120a68592029f8b2247097ed8c4660a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'migration_context' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<d1ad1db4-d19c-42d6-a7af-3296b6c7c461> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Start _get_guest_xml network_info=[{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "vif_mac": "fa:16:3e:a9:55:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ce221228-def1-4cd3-bc94-e77637e87e30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '0c9e1838-83bd-4104-a5d0-5e5cd45d4c00', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd1ad1db4-d19c-42d6-a7af-3296b6c7c461', 'attached_at': '', 'detached_at': '', 'volume_id': '6ec12c5b-6363-4442-8b4e-f949e29d8067', 'serial': '6ec12c5b-6363-4442-8b4e-f949e29d8067'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'resources' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<d1ad1db4-d19c-42d6-a7af-3296b6c7c461> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'numa_topology' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<d1ad1db4-d19c-42d6-a7af-3296b6c7c461> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:35:17 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:35:17 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<d1ad1db4-d19c-42d6-a7af-3296b6c7c461> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:35:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:35:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:35:17 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[62db4dda-e0ab-4cf7-b0ea-6150d9dad01b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ftuNHOrz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 15:35:17 user nova-compute[74421]: node.name = iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067
Oct 23 15:35:17 user nova-compute[74421]: node.tpgt = -1
Oct 23 15:35:17 user nova-compute[74421]: node.startup = automatic
Oct 23 15:35:17 user nova-compute[74421]: node.leading_login = No
Oct 23 15:35:17 user nova-compute[74421]: iface.iscsi_ifacename = default
Oct 23 15:35:17 user nova-compute[74421]: iface.net_ifacename = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.ipaddress = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.prefix_len = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.hwaddress = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.transport_name = tcp
Oct 23 15:35:17 user nova-compute[74421]: iface.initiatorname = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.vlan_id = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.vlan_priority = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.vlan_state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.iface_num = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.mtu = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.port = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.bootproto = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.subnet_mask = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.gateway = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_alt_client_id = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_dns = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_learn_iqn = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_vendor_id_state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_vendor_id = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.dhcp_slp_da = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.fragmentation = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.gratuitous_arp = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.incoming_forwarding = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.tos_state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.tos = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.ttl = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.delayed_ack = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.tcp_nagle = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.tcp_wsf_state = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.tcp_wsf = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.tcp_timer_scale = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.tcp_timestamp = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.redirect = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.def_task_mgmt_timeout = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.header_digest = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.data_digest = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.immediate_data = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.initial_r2t = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.data_seq_inorder = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.data_pdu_inorder = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.erl = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.max_receive_data_len = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.first_burst_len = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.max_outstanding_r2t = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.max_burst_len = 0
Oct 23 15:35:17 user nova-compute[74421]: iface.chap_auth = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.bidi_chap = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.strict_login_compliance = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.discovery_auth = <empty>
Oct 23 15:35:17 user nova-compute[74421]: iface.discovery_logout = <empty>
Oct 23 15:35:17 user nova-compute[74421]: node.discovery_address = <empty>
Oct 23 15:35:17 user nova-compute[74421]: node.discovery_port = 0
Oct 23 15:35:17 user nova-compute[74421]: node.discovery_type = static
Oct 23 15:35:17 user nova-compute[74421]: node.session.initial_cmdsn = 0
Oct 23 15:35:17 user nova-compute[74421]: node.session.initial_login_retry_max = 8
Oct 23 15:35:17 user nova-compute[74421]: node.session.xmit_thread_priority = -20
Oct 23 15:35:17 user nova-compute[74421]: node.session.cmds_max = 128
Oct 23 15:35:17 user nova-compute[74421]: node.session.queue_depth = 32
Oct 23 15:35:17 user nova-compute[74421]: node.session.nr_sessions = 1
Oct 23 15:35:17 user nova-compute[74421]: node.session.auth.authmethod = CHAP
Oct 23 15:35:17 user nova-compute[74421]: node.session.auth.username = ftuNHOrz
Oct 23 15:35:17 user nova-compute[74421]: node.session.auth.password = ***
Oct 23 15:35:17 user nova-compute[74421]: node.session.auth.username_in = <empty>
Oct 23 15:35:17 user nova-compute[74421]: node.session.auth.password_in = <empty>
Oct 23 15:35:17 user nova-compute[74421]: node.session.auth.chap_algs = MD5
Oct 23 15:35:17 user nova-compute[74421]: node.session.timeo.replacement_timeout = 120
Oct 23 15:35:17 user nova-compute[74421]: node.session.err_timeo.abort_timeout = 15
Oct 23 15:35:17 user nova-compute[74421]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 15:35:17 user nova-compute[74421]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 15:35:17 user nova-compute[74421]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.FastAbort = Yes
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.InitialR2T = No
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.ImmediateData = Yes
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.MaxConnections = 1
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 15:35:17 user nova-compute[74421]: node.session.iscsi.ERL = 0
Oct 23 15:35:17 user nova-compute[74421]: node.session.scan = manual
Oct 23 15:35:17 user nova-compute[74421]: node.session.reopen_max = 0
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].address = 172.16.0.220
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].port = 3260
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].startup = manual
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].tcp.window_size = 524288
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].tcp.type_of_service = 0
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].timeo.logout_timeout = 15
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].timeo.login_timeout = 15
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].timeo.auth_timeout = 45
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].iscsi.DataDigest = None
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].iscsi.IFMarker = No
Oct 23 15:35:17 user nova-compute[74421]: node.conn[0].iscsi.OFMarker = No
Oct 23 15:35:17 user nova-compute[74421]: # END RECORD
Oct 23 15:35:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe0ef6a-0042-423f-9abf-1890af790d5f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c888166-f9af-4191-ac84-27a0dfcfc125]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftuNHOrz {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftuNHOrz" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc6b03-9b2d-49b0-915c-dbc8780c97f1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftuNHOrz'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cefcc77-3794-4a92-a464-b483d922a0e4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56569e0-b6a4-49e3-bc68-6a020e150913]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:17 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:17 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:17 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:17 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] HCTL ('33', '0', '0', 0) found on session 28 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a77d287-7c7b-41ad-9953-c9807dbf92f5]: (4, ('0 0 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Searching for a device in session 28 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '23839396361663165', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839396361663165', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1964539500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1964539500',id=30,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-4z2qr04e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:34:05Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=d1ad1db4-d19c-42d6-a7af-3296b6c7c461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "vif_mac": "fa:16:3e:a9:55:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "vif_mac": "fa:16:3e:a9:55:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'pci_devices' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.objects.base [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Object Instance<d1ad1db4-d19c-42d6-a7af-3296b6c7c461> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:35:17 user nova-compute[74421]:   <uuid>d1ad1db4-d19c-42d6-a7af-3296b6c7c461</uuid>
Oct 23 15:35:17 user nova-compute[74421]:   <name>instance-0000001e</name>
Oct 23 15:35:17 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:35:17 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:35:17 user nova-compute[74421]:   <metadata>
Oct 23 15:35:17 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:35:17 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:35:17 user nova-compute[74421]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1964539500</nova:name>
Oct 23 15:35:17 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:35:17</nova:creationTime>
Oct 23 15:35:17 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:35:17 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:35:17 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:35:17 user nova-compute[74421]:       <nova:owner>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:user uuid="166776dcccda43409673d99af45d4390">tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member</nova:user>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:project uuid="f733f39c7c95492abc827bd581ca7afa">tempest-ServerBootFromVolumeStableRescueTest-2014752681</nova:project>
Oct 23 15:35:17 user nova-compute[74421]:       </nova:owner>
Oct 23 15:35:17 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:35:17 user nova-compute[74421]:       <nova:ports>
Oct 23 15:35:17 user nova-compute[74421]:         <nova:port uuid="06515616-6772-42e4-be50-62701e4b4fcb">
Oct 23 15:35:17 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 15:35:17 user nova-compute[74421]:         </nova:port>
Oct 23 15:35:17 user nova-compute[74421]:       </nova:ports>
Oct 23 15:35:17 user nova-compute[74421]:     </nova:instance>
Oct 23 15:35:17 user nova-compute[74421]:   </metadata>
Oct 23 15:35:17 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:35:17 user nova-compute[74421]:     <system>
Oct 23 15:35:17 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:35:17 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:35:17 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:35:17 user nova-compute[74421]:       <entry name="serial">d1ad1db4-d19c-42d6-a7af-3296b6c7c461</entry>
Oct 23 15:35:17 user nova-compute[74421]:       <entry name="uuid">d1ad1db4-d19c-42d6-a7af-3296b6c7c461</entry>
Oct 23 15:35:17 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:35:17 user nova-compute[74421]:     </system>
Oct 23 15:35:17 user nova-compute[74421]:   </sysinfo>
Oct 23 15:35:17 user nova-compute[74421]:   <os>
Oct 23 15:35:17 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:35:17 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:35:17 user nova-compute[74421]:   </os>
Oct 23 15:35:17 user nova-compute[74421]:   <features>
Oct 23 15:35:17 user nova-compute[74421]:     <acpi/>
Oct 23 15:35:17 user nova-compute[74421]:     <apic/>
Oct 23 15:35:17 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:35:17 user nova-compute[74421]:   </features>
Oct 23 15:35:17 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:35:17 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:35:17 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:35:17 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:35:17 user nova-compute[74421]:   </clock>
Oct 23 15:35:17 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:35:17 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:35:17 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:35:17 user nova-compute[74421]:   </cpu>
Oct 23 15:35:17 user nova-compute[74421]:   <devices>
Oct 23 15:35:17 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:35:17 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:35:17 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:35:17 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:35:17 user nova-compute[74421]:       <serial>6ec12c5b-6363-4442-8b4e-f949e29d8067</serial>
Oct 23 15:35:17 user nova-compute[74421]:     </disk>
Oct 23 15:35:17 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:35:17 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:35:17 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue"/>
Oct 23 15:35:17 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:35:17 user nova-compute[74421]:       <boot order="1"/>
Oct 23 15:35:17 user nova-compute[74421]:     </disk>
Oct 23 15:35:17 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:35:17 user nova-compute[74421]:       <mac address="fa:16:3e:a9:55:c5"/>
Oct 23 15:35:17 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:35:17 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:35:17 user nova-compute[74421]:       <target dev="tap06515616-67"/>
Oct 23 15:35:17 user nova-compute[74421]:     </interface>
Oct 23 15:35:17 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:35:17 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/console.log" append="off"/>
Oct 23 15:35:17 user nova-compute[74421]:     </serial>
Oct 23 15:35:17 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:35:17 user nova-compute[74421]:     <video>
Oct 23 15:35:17 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:35:17 user nova-compute[74421]:     </video>
Oct 23 15:35:17 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:35:17 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:35:17 user nova-compute[74421]:     </rng>
Oct 23 15:35:17 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:35:17 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:35:17 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:35:17 user nova-compute[74421]:     </memballoon>
Oct 23 15:35:17 user nova-compute[74421]:   </devices>
Oct 23 15:35:17 user nova-compute[74421]: </domain>
Oct 23 15:35:17 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:35:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance destroyed successfully.
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:35:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] No VIF found with MAC fa:16:3e:a9:55:c5, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNjPkhQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:35:18 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:35:18 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:35:18 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d681da-924d-4b28-958b-40b9bcd4272c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:35:18 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f346a27-ff8b-4693-a27c-3420630fc411]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a] added
Oct 23 15:35:18 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8f053-d4d3-45f5-8163-46acca4141e1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e3377-792e-4dce-9111-54fdbb906871]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNjPkhQz {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNjPkhQz" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f7dfcc-45ab-4b09-8a59-14de7a179603]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNjPkhQz'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675e14f-ed40-4041-9535-61a1e129dea5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a4202-d26c-4553-a577-fcb0d1fb0316]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:18 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:18 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:18 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:18 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:18 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:18 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:35:18 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-b4d2c4d4-f269-4012-8d2a-78e11edf7071 req-a1648c18-8bbb-4eaf-9a77-b85db19bb569 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b4d2c4d4-f269-4012-8d2a-78e11edf7071 req-a1648c18-8bbb-4eaf-9a77-b85db19bb569 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b4d2c4d4-f269-4012-8d2a-78e11edf7071 req-a1648c18-8bbb-4eaf-9a77-b85db19bb569 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b4d2c4d4-f269-4012-8d2a-78e11edf7071 req-a1648c18-8bbb-4eaf-9a77-b85db19bb569 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-b4d2c4d4-f269-4012-8d2a-78e11edf7071 req-a1648c18-8bbb-4eaf-9a77-b85db19bb569 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:19 user nova-compute[74421]: WARNING nova.compute.manager [req-b4d2c4d4-f269-4012-8d2a-78e11edf7071 req-a1648c18-8bbb-4eaf-9a77-b85db19bb569 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state active and task_state rescuing.
Oct 23 15:35:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --login" returned: 0 in 1.080s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454e0c4-c7b1-4754-bbe9-a876b5c7262c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260]
Oct 23 15:35:20 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260] successful.
Oct 23 15:35:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e85a4-f525-41ed-a4e1-41e5768baec2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bd161-5abc-462a-a8b7-63ae17b6d26e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:20 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:20 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:20 user nova-compute[74421]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a (non-flash)
Oct 23 15:35:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:20 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:20 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:20 user nova-compute[74421]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a (non-flash)
Oct 23 15:35:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.352s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d18496-3282-43c5-ad24-cf10ed1ee0b6]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNjPkhQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:35:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.400s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== connect_volume: return (2401ms) {'type': 'block', 'scsi_wwn': '23137393633333266', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137393633333266', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.objects.instance [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:35:21 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:35:21 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:35:21 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:35:21 user nova-compute[74421]:   <serial>7cc2fb13-45d8-4547-86f3-a05e69fd7b9a</serial>
Oct 23 15:35:21 user nova-compute[74421]: </disk>
Oct 23 15:35:21 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] No VIF found with MAC fa:16:3e:f4:ae:41, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-01e23139-89f5-447b-8167-998f5e3e1d39 req-334169f3-f316-4bcf-8dd5-f13a49a2faa2 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-01e23139-89f5-447b-8167-998f5e3e1d39 req-334169f3-f316-4bcf-8dd5-f13a49a2faa2 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-01e23139-89f5-447b-8167-998f5e3e1d39 req-334169f3-f316-4bcf-8dd5-f13a49a2faa2 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-01e23139-89f5-447b-8167-998f5e3e1d39 req-334169f3-f316-4bcf-8dd5-f13a49a2faa2 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-01e23139-89f5-447b-8167-998f5e3e1d39 req-334169f3-f316-4bcf-8dd5-f13a49a2faa2 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:21 user nova-compute[74421]: WARNING nova.compute.manager [req-01e23139-89f5-447b-8167-998f5e3e1d39 req-334169f3-f316-4bcf-8dd5-f13a49a2faa2 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state active and task_state rescuing.
Oct 23 15:35:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-02e81ff2-a5ae-4ab2-b4b9-9ff7224ac5b0 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.819s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a30c0806-b803-4fa6-a165-f21f3c14d6e1 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:35:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:23 user nova-compute[74421]: INFO nova.compute.manager [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Detaching volume 7cc2fb13-45d8-4547-86f3-a05e69fd7b9a
Oct 23 15:35:23 user nova-compute[74421]: INFO nova.virt.block_device [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Attempting to driver detach volume 7cc2fb13-45d8-4547-86f3-a05e69fd7b9a from mountpoint /dev/vdb
Oct 23 15:35:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Attempting to detach device vdb from instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:35:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:35:23 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:35:23 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:35:23 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:35:23 user nova-compute[74421]:   <serial>7cc2fb13-45d8-4547-86f3-a05e69fd7b9a</serial>
Oct 23 15:35:23 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:35:23 user nova-compute[74421]: </disk>
Oct 23 15:35:23 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:35:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully detached device vdb from instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 from the persistent domain config.
Oct 23 15:35:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:35:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:35:23 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:35:23 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:35:23 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:35:23 user nova-compute[74421]:   <serial>7cc2fb13-45d8-4547-86f3-a05e69fd7b9a</serial>
Oct 23 15:35:23 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:35:23 user nova-compute[74421]: </disk>
Oct 23 15:35:23 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:35:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:35:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:28 user nova-compute[74421]: INFO nova.compute.manager [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Unrescuing
Oct 23 15:35:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:28 user nova-compute[74421]: DEBUG nova.network.neutron [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG nova.objects.instance [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'flavor' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-e174885c-7282-4677-a0fe-aa69c112dae2 req-74b13647-0f23-4d7e-a6f9-d032445abe7f service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e174885c-7282-4677-a0fe-aa69c112dae2 req-74b13647-0f23-4d7e-a6f9-d032445abe7f service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e174885c-7282-4677-a0fe-aa69c112dae2 req-74b13647-0f23-4d7e-a6f9-d032445abe7f service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e174885c-7282-4677-a0fe-aa69c112dae2 req-74b13647-0f23-4d7e-a6f9-d032445abe7f service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-e174885c-7282-4677-a0fe-aa69c112dae2 req-74b13647-0f23-4d7e-a6f9-d032445abe7f service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:29 user nova-compute[74421]: WARNING nova.compute.manager [req-e174885c-7282-4677-a0fe-aa69c112dae2 req-74b13647-0f23-4d7e-a6f9-d032445abe7f service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:35:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:30 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance destroyed successfully.
Oct 23 15:35:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-bf328c50-de70-4909-973a-c66f2e5c88bb req-1cf17fc4-a9f7-4f03-b9e8-e5712963fd69 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bf328c50-de70-4909-973a-c66f2e5c88bb req-1cf17fc4-a9f7-4f03-b9e8-e5712963fd69 service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bf328c50-de70-4909-973a-c66f2e5c88bb req-1cf17fc4-a9f7-4f03-b9e8-e5712963fd69 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bf328c50-de70-4909-973a-c66f2e5c88bb req-1cf17fc4-a9f7-4f03-b9e8-e5712963fd69 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-bf328c50-de70-4909-973a-c66f2e5c88bb req-1cf17fc4-a9f7-4f03-b9e8-e5712963fd69 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:32 user nova-compute[74421]: WARNING nova.compute.manager [req-bf328c50-de70-4909-973a-c66f2e5c88bb req-1cf17fc4-a9f7-4f03-b9e8-e5712963fd69 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:35:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-74e9352e-4b02-4917-9a19-0be43e00cf39 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:35:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-f43d6366-71db-44ce-978d-7d3124875cdd req-4dbb2011-9275-43b3-91c6-887ce1cc4b3e service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f43d6366-71db-44ce-978d-7d3124875cdd req-4dbb2011-9275-43b3-91c6-887ce1cc4b3e service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f43d6366-71db-44ce-978d-7d3124875cdd req-4dbb2011-9275-43b3-91c6-887ce1cc4b3e service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f43d6366-71db-44ce-978d-7d3124875cdd req-4dbb2011-9275-43b3-91c6-887ce1cc4b3e service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-f43d6366-71db-44ce-978d-7d3124875cdd req-4dbb2011-9275-43b3-91c6-887ce1cc4b3e service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:36 user nova-compute[74421]: WARNING nova.compute.manager [req-f43d6366-71db-44ce-978d-7d3124875cdd req-4dbb2011-9275-43b3-91c6-887ce1cc4b3e service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state active and task_state None.
Oct 23 15:35:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-da8ea114-37c3-4528-8bd7-39d594e71398 req-f67003d2-2a00-4f03-914b-d00be0b47d5d service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-da8ea114-37c3-4528-8bd7-39d594e71398 req-f67003d2-2a00-4f03-914b-d00be0b47d5d service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-da8ea114-37c3-4528-8bd7-39d594e71398 req-f67003d2-2a00-4f03-914b-d00be0b47d5d service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-da8ea114-37c3-4528-8bd7-39d594e71398 req-f67003d2-2a00-4f03-914b-d00be0b47d5d service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-da8ea114-37c3-4528-8bd7-39d594e71398 req-f67003d2-2a00-4f03-914b-d00be0b47d5d service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:38 user nova-compute[74421]: WARNING nova.compute.manager [req-da8ea114-37c3-4528-8bd7-39d594e71398 req-f67003d2-2a00-4f03-914b-d00be0b47d5d service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state active and task_state None.
Oct 23 15:35:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:43 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:44 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 is timed out.
Oct 23 15:35:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully detached device vdb from instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 from the live domain config.
Oct 23 15:35:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNjPkhQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:35:44 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70df0f9-d0fc-406d-b6cb-1961ae72b1f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:35:44 user nova-compute[74421]: No targets found.
Oct 23 15:35:44 user nova-compute[74421]: iSNS:
Oct 23 15:35:44 user nova-compute[74421]: No targets found.
Oct 23 15:35:44 user nova-compute[74421]: STATIC:
Oct 23 15:35:44 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:35:44 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:44 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:44 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067
Oct 23 15:35:44 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:44 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:44 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:35:44 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:44 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:44 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a
Oct 23 15:35:44 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:44 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:44 user nova-compute[74421]: FIRMWARE:
Oct 23 15:35:44 user nova-compute[74421]: No targets found.
Oct 23 15:35:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:35:44 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:35:44 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6cdb1-16b9-4566-89fc-c303e0b42b1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c1c76-48ad-4910-b969-c47a93444a27]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:44 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:44 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:44 user nova-compute[74421]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a (non-flash)
Oct 23 15:35:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:44 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:44 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:44 user nova-compute[74421]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a (non-flash)
Oct 23 15:35:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478136680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5c8ae7-d020-48e6-a24c-bc359fbf3bf6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4331f-f4f5-462c-80f4-3219b24ad3c4]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4a51d1-0e4d-4498-a5a9-5349c96cd8e3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8e1d3c-43d7-4135-821d-209cc6096484]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb2518-685d-43c0-84dc-d44ffc02833e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f792b7c9-29ea-4b73-a9d0-ebd2bd198787]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260]
Oct 23 15:35:44 user nova-compute[74421]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a, portal: 172.16.0.220,3260] successful.
Oct 23 15:35:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc2fb13-45d8-4547-86f3-a05e69fd7b9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a6414-10a7-4a19-96d1-4c91b795cabc]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] <== disconnect_volume: return (385ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:35:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:35:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:45 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'flavor' on Instance uuid a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:35:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d7a447b6-a1df-4c7a-b1e0-f81034be1576 tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.126s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:35:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:35:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-changed-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.manager [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Refreshing instance network info cache due to event network-changed-4601ea46-2069-471a-8de8-0547b9aea8c9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.network.neutron [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Refreshing network info cache for port 4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:35:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:35:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7632MB free_disk=24.989452362060547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 71f11170-4d47-419e-a067-dbc82352a8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8e63a09b-624d-4bf2-8d8a-77225bd34a8d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.network.neutron [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updated VIF entry in instance network info cache for port 4601ea46-2069-471a-8de8-0547b9aea8c9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.network.neutron [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-47e58b7f-6e39-495d-88d2-5c90be36890b req-7ef4988f-d1cf-4bf6-b0bf-45a3483fbefd service nova] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.467s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:51 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:35:51 user nova-compute[74421]: INFO nova.compute.claims [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Claim successful on node user
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:35:52 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.policy [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cac7200691824d7ca5a62ae55959832d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5d845cfc547f69e20081a6e42c3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:35:52 user nova-compute[74421]: INFO nova.virt.block_device [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Booting with volume 1ce69ea3-e893-4552-b7d8-ab9396edad6c at /dev/vda
Oct 23 15:35:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e573e-e882-4066-845b-9dbc3c1da9a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbcb517-b7cd-4d46-a2c0-b03b49c8162d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Stashing vm_state: active {{(pid=74421) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177b608-369f-4780-bd7b-76e98fea9c67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c59c22c-d8fc-4f1b-8865-8967c5fd01c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:35:52 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b92ce98-1153-45d6-ad72-883dce7d32fd]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating existing volume attachment record: 15b351e2-1357-4fd5-922f-71535c5bbf3e {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:35:52 user nova-compute[74421]: INFO nova.compute.claims [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Claim successful on node user
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:52 user nova-compute[74421]: INFO nova.compute.resource_tracker [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating resource usage from migration 57b5c93d-c837-486c-8d95-6759bcc98547
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-changed-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Refreshing instance network info cache due to event network-changed-97945e10-06c5-453a-9e05-359a5b48ae0b. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] Acquiring lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] Acquired lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Refreshing network info cache for port 97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Successfully created port: c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.557s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:53 user nova-compute[74421]: INFO nova.compute.manager [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Migrating
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updated VIF entry in instance network info cache for port 97945e10-06c5-453a-9e05-359a5b48ae0b. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1a5f3a93-d238-4534-83d6-fb8d054d56f1 req-03d8bbc5-abc4-438f-b170-ef7a8d4fe366 service nova] Releasing lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquired lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:35:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Successfully updated port: c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing instance network info cache due to event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Releasing lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Starting migrate_disk_and_power_off {{(pid=74421) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance network_info: |[{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-4b375edf-e610-4c64-a4a2-150727aab46e req-c1eefa15-21e5-47bc-858d-b2ef6f1d2540 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-unplugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4b375edf-e610-4c64-a4a2-150727aab46e req-c1eefa15-21e5-47bc-858d-b2ef6f1d2540 service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4b375edf-e610-4c64-a4a2-150727aab46e req-c1eefa15-21e5-47bc-858d-b2ef6f1d2540 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4b375edf-e610-4c64-a4a2-150727aab46e req-c1eefa15-21e5-47bc-858d-b2ef6f1d2540 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-4b375edf-e610-4c64-a4a2-150727aab46e req-c1eefa15-21e5-47bc-858d-b2ef6f1d2540 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-unplugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:54 user nova-compute[74421]: WARNING nova.compute.manager [req-4b375edf-e610-4c64-a4a2-150727aab46e req-c1eefa15-21e5-47bc-858d-b2ef6f1d2540 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-unplugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state active and task_state resize_migrating.
Oct 23 15:35:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updated VIF entry in instance network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG nova.network.neutron [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cd0fa01e-ba8e-486e-85f0-50fab219092b req-ee0d82dc-e10f-4836-8060-7475b879b3c0 service nova] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance destroyed successfully.
Oct 23 15:35:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323723003',display_name='tempest-ServerActionsTestOtherA-server-1323723003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323723003',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:34:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-9v52yphd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=71f11170-4d47-419e-a067-dbc82352a8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97945e10-06, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86dc398f-af0d-4f93-86bc-8c117b56cca0) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:55 user nova-compute[74421]: INFO os_vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06')
Oct 23 15:35:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:35:55 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[794d5176-d430-4b1f-8854-47d777363d98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:35:55 user nova-compute[74421]: No targets found.
Oct 23 15:35:55 user nova-compute[74421]: iSNS:
Oct 23 15:35:55 user nova-compute[74421]: No targets found.
Oct 23 15:35:55 user nova-compute[74421]: STATIC:
Oct 23 15:35:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:35:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067
Oct 23 15:35:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:55 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:35:55 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:35:55 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:35:55 user nova-compute[74421]: FIRMWARE:
Oct 23 15:35:55 user nova-compute[74421]: No targets found.
Oct 23 15:35:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:35:55 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:35:55 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba5f1a9-54e5-4bec-95ee-f9e3ee795867]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc5f378-b0a5-4907-9f4e-401c13af39f2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:55 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:55 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:35:55 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:35:55 user nova-compute[74421]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:35:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247831d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47229fc-9f06-4219-bc13-0a04015e691c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[834cd56b-f0e7-49fb-b7ae-0a749b46991f]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[da674bc3-fcec-4b20-aa82-f0234d3f11d8]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc04fe4-5236-4b2a-b79b-991343283040]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9fa78306',) {{(pid=85617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d85b5-726d-4fa1-92b7-77e6b01d606c]: (4, None) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8159ecc3-16c4-4142-b1ee-825aca10847d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4c4d4-6bea-4d79-ad2b-d3ab5beab9af]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]
Oct 23 15:35:55 user nova-compute[74421]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.
Oct 23 15:35:55 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b7f30-815c-4d17-808e-ce250f30a567]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== disconnect_volume: return (330ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:35:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Port 97945e10-06c5-453a-9e05-359a5b48ae0b binding to destination host user is already ACTIVE {{(pid=74421) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-3e26e73a-1a1e-49ef-9e02-c07cfaecdb53 req-8f180eb1-00fd-4316-bbb9-bd076b164da9 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3e26e73a-1a1e-49ef-9e02-c07cfaecdb53 req-8f180eb1-00fd-4316-bbb9-bd076b164da9 service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3e26e73a-1a1e-49ef-9e02-c07cfaecdb53 req-8f180eb1-00fd-4316-bbb9-bd076b164da9 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3e26e73a-1a1e-49ef-9e02-c07cfaecdb53 req-8f180eb1-00fd-4316-bbb9-bd076b164da9 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-3e26e73a-1a1e-49ef-9e02-c07cfaecdb53 req-8f180eb1-00fd-4316-bbb9-bd076b164da9 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:35:56 user nova-compute[74421]: WARNING nova.compute.manager [req-3e26e73a-1a1e-49ef-9e02-c07cfaecdb53 req-8f180eb1-00fd-4316-bbb9-bd076b164da9 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state active and task_state resize_migrated.
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquired lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:35:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Releasing lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG os_brick.utils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dbbb82-2816-49b6-9f59-bc271b0285ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7722e1-f005-4284-b2e5-02c6e7d6edf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57221f7a-3cd4-40e8-be09-59cacbc6b5c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c590f-c55b-421a-87c2-13e7ef55de2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:35:57 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:35:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d3ac33-2361-46fc-92d2-2f0e758a12e9]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:35:57 user nova-compute[74421]: DEBUG os_brick.utils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:36:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:02 user nova-compute[74421]: INFO nova.compute.manager [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Unshelving
Oct 23 15:36:02 user nova-compute[74421]: INFO nova.virt.block_device [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Booting with volume eebd686e-2249-4dc9-ad4c-0bda208cae86 at /dev/vdc
Oct 23 15:36:02 user nova-compute[74421]: DEBUG os_brick.utils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5595654e-4223-483f-8136-1fc281976bc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[89945732-f6b0-4f8d-ac2d-da52073bb975]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3376f66b-2376-4438-bc01-9048d2ffe148]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9c18c9-3862-4b66-8a2a-235054b9928b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:36:02 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:36:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[315ab055-1c70-4350-a408-62b023aa69a1]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG os_brick.utils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:36:02 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating existing volume attachment record: e4424aca-03e7-4821-80e4-c432ca419222 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:36:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:36:12 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Creating image(s)
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Ensure instance console log exists: /opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Start _get_guest_xml network_info=[{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '15b351e2-1357-4fd5-922f-71535c5bbf3e', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e63a09b-624d-4bf2-8d8a-77225bd34a8d', 'attached_at': '', 'detached_at': '', 'volume_id': '1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'serial': '1ce69ea3-e893-4552-b7d8-ab9396edad6c'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:36:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:36:12 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:36:12 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:36:12 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04bff40-7d64-4d52-84b3-39215dd25398]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:36:12 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8edcc5e-3c72-4f89-b5a2-cfe2e76db583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c] added
Oct 23 15:36:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed877cf-c9f4-4f9c-9c63-48a2e314fad1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c8ff6-001a-4aa8-9bd9-6de0bc61a573]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFvUWLYd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFvUWLYd" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a466d56f-50a5-4e89-8351-41181a7952ef]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wFvUWLYd'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8e9bd-0086-430b-b389-85d1ff81fb9f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6a8619-f7a2-4aa2-b43e-70b7379c4f85]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d19fdb-6a68-45ac-a316-525b4f06c9b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]
Oct 23 15:36:12 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.
Oct 23 15:36:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bf03ef-8014-4629-9566-a2c86edb40d8]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd19906-adda-40f7-9821-7cd9df0963c0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:12 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0c65a-c002-4dfe-b4ba-30e631aa7307]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:36:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23164663238353337', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164663238353337', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-474494279',display_name='tempest-TestShelveInstance-server-474494279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-474494279',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2OSiezPrLZHl4M39rxTh4qzpR3tldswq9wUaxP32WtQzURZCFBfLo5or+FYD0CFK6Nr18rS+/72Nw2QBDKxhjBDBOTPBSHsIIW1MzcCQGZvyIkgzlnKvEKOJaFxfdlw==',key_name='tempest-TestShelveInstance-1680132638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79f5d845cfc547f69e20081a6e42c3eb',ramdisk_id='',reservation_id='r-86c22pno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1665380191',owner_user_name='tempest-TestShelveInstance-1665380191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:35:53Z,user_data=None,user_id='cac7200691824d7ca5a62ae55959832d',uuid=8e63a09b-624d-4bf2-8d8a-77225bd34a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converting VIF {"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:36:13 user nova-compute[74421]:   <uuid>8e63a09b-624d-4bf2-8d8a-77225bd34a8d</uuid>
Oct 23 15:36:13 user nova-compute[74421]:   <name>instance-00000021</name>
Oct 23 15:36:13 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:36:13 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:36:13 user nova-compute[74421]:   <metadata>
Oct 23 15:36:13 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:36:13 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:36:13 user nova-compute[74421]:       <nova:name>tempest-TestShelveInstance-server-474494279</nova:name>
Oct 23 15:36:13 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:36:12</nova:creationTime>
Oct 23 15:36:13 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:36:13 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:36:13 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:36:13 user nova-compute[74421]:       <nova:owner>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:user uuid="cac7200691824d7ca5a62ae55959832d">tempest-TestShelveInstance-1665380191-project-member</nova:user>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:project uuid="79f5d845cfc547f69e20081a6e42c3eb">tempest-TestShelveInstance-1665380191</nova:project>
Oct 23 15:36:13 user nova-compute[74421]:       </nova:owner>
Oct 23 15:36:13 user nova-compute[74421]:       <nova:ports>
Oct 23 15:36:13 user nova-compute[74421]:         <nova:port uuid="c99a03a6-437c-4469-9bf8-95ba5b7d6ae4">
Oct 23 15:36:13 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:36:13 user nova-compute[74421]:         </nova:port>
Oct 23 15:36:13 user nova-compute[74421]:       </nova:ports>
Oct 23 15:36:13 user nova-compute[74421]:     </nova:instance>
Oct 23 15:36:13 user nova-compute[74421]:   </metadata>
Oct 23 15:36:13 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:36:13 user nova-compute[74421]:     <system>
Oct 23 15:36:13 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:36:13 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:36:13 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:36:13 user nova-compute[74421]:       <entry name="serial">8e63a09b-624d-4bf2-8d8a-77225bd34a8d</entry>
Oct 23 15:36:13 user nova-compute[74421]:       <entry name="uuid">8e63a09b-624d-4bf2-8d8a-77225bd34a8d</entry>
Oct 23 15:36:13 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:36:13 user nova-compute[74421]:     </system>
Oct 23 15:36:13 user nova-compute[74421]:   </sysinfo>
Oct 23 15:36:13 user nova-compute[74421]:   <os>
Oct 23 15:36:13 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:36:13 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:36:13 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:36:13 user nova-compute[74421]:   </os>
Oct 23 15:36:13 user nova-compute[74421]:   <features>
Oct 23 15:36:13 user nova-compute[74421]:     <acpi/>
Oct 23 15:36:13 user nova-compute[74421]:     <apic/>
Oct 23 15:36:13 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:36:13 user nova-compute[74421]:   </features>
Oct 23 15:36:13 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:36:13 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:36:13 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:36:13 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:36:13 user nova-compute[74421]:   </clock>
Oct 23 15:36:13 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:36:13 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:36:13 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:36:13 user nova-compute[74421]:   </cpu>
Oct 23 15:36:13 user nova-compute[74421]:   <devices>
Oct 23 15:36:13 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:36:13 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:36:13 user nova-compute[74421]:       <source dev="/dev/sdc"/>
Oct 23 15:36:13 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:36:13 user nova-compute[74421]:       <serial>1ce69ea3-e893-4552-b7d8-ab9396edad6c</serial>
Oct 23 15:36:13 user nova-compute[74421]:     </disk>
Oct 23 15:36:13 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:36:13 user nova-compute[74421]:       <mac address="fa:16:3e:98:76:0c"/>
Oct 23 15:36:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:13 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:36:13 user nova-compute[74421]:       <target dev="tapc99a03a6-43"/>
Oct 23 15:36:13 user nova-compute[74421]:     </interface>
Oct 23 15:36:13 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:36:13 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d/console.log" append="off"/>
Oct 23 15:36:13 user nova-compute[74421]:     </serial>
Oct 23 15:36:13 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:36:13 user nova-compute[74421]:     <video>
Oct 23 15:36:13 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:13 user nova-compute[74421]:     </video>
Oct 23 15:36:13 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:36:13 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:36:13 user nova-compute[74421]:     </rng>
Oct 23 15:36:13 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:36:13 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:36:13 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:36:13 user nova-compute[74421]:     </memballoon>
Oct 23 15:36:13 user nova-compute[74421]:   </devices>
Oct 23 15:36:13 user nova-compute[74421]: </domain>
Oct 23 15:36:13 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-474494279',display_name='tempest-TestShelveInstance-server-474494279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-474494279',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2OSiezPrLZHl4M39rxTh4qzpR3tldswq9wUaxP32WtQzURZCFBfLo5or+FYD0CFK6Nr18rS+/72Nw2QBDKxhjBDBOTPBSHsIIW1MzcCQGZvyIkgzlnKvEKOJaFxfdlw==',key_name='tempest-TestShelveInstance-1680132638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79f5d845cfc547f69e20081a6e42c3eb',ramdisk_id='',reservation_id='r-86c22pno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1665380191',owner_user_name='tempest-TestShelveInstance-1665380191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:35:53Z,user_data=None,user_id='cac7200691824d7ca5a62ae55959832d',uuid=8e63a09b-624d-4bf2-8d8a-77225bd34a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converting VIF {"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG os_vif [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '034a26f5-7020-5b4a-be1b-d4190e196572', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc99a03a6-43, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc99a03a6-43, col_values=(('qos', UUID('06a5a435-98c0-4b24-9cf0-aacf24b5f7f3')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc99a03a6-43, col_values=(('external_ids', {'iface-id': 'c99a03a6-437c-4469-9bf8-95ba5b7d6ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:76:0c', 'vm-uuid': '8e63a09b-624d-4bf2-8d8a-77225bd34a8d'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:13 user nova-compute[74421]: INFO os_vif [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43')
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:36:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] No VIF found with MAC fa:16:3e:98:76:0c, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:14 user nova-compute[74421]: INFO nova.compute.manager [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Terminating instance
Oct 23 15:36:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-01a1bf18-817f-492f-8f59-e24a6d30c4a2 req-0d1d609a-bf95-497e-bc39-fe61052a84aa service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-unplugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-01a1bf18-817f-492f-8f59-e24a6d30c4a2 req-0d1d609a-bf95-497e-bc39-fe61052a84aa service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-01a1bf18-817f-492f-8f59-e24a6d30c4a2 req-0d1d609a-bf95-497e-bc39-fe61052a84aa service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-01a1bf18-817f-492f-8f59-e24a6d30c4a2 req-0d1d609a-bf95-497e-bc39-fe61052a84aa service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-01a1bf18-817f-492f-8f59-e24a6d30c4a2 req-0d1d609a-bf95-497e-bc39-fe61052a84aa service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-unplugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-01a1bf18-817f-492f-8f59-e24a6d30c4a2 req-0d1d609a-bf95-497e-bc39-fe61052a84aa service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-unplugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Instance destroyed successfully.
Oct 23 15:36:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lazy-loading 'resources' on Instance uuid a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1643621896',display_name='tempest-AttachVolumeNegativeTest-server-1643621896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1643621896',id=29,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTjX0fq+IENZeripwsShLRTE/suUj7lTdVSeqgF9GBeT+s6jxtWZ+xJ4K2cSi6bz4Sdt8JmiuaZiZnTSm3kgelv1QUKglh0H6oPHYzNXj9zn9tnVlMV7xN0zxaTbwAkw==',key_name='tempest-keypair-449066379',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:33:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74e90bcb97e74feaa5e6247b7fc0d3f2',ramdisk_id='',reservation_id='r-7gmylesb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-100322526',owner_user_name='tempest-AttachVolumeNegativeTest-100322526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e711d55fe644a0ca518fa34d187b79f',uuid=a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converting VIF {"id": "f3e9f491-f219-4b09-b93f-fd0192567eef", "address": "fa:16:3e:f4:ae:41", "network": {"id": "3b56b122-f894-4c5b-a1bd-8e91d4edad1d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004836101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74e90bcb97e74feaa5e6247b7fc0d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e9f491-f2", "ovs_interfaceid": "f3e9f491-f219-4b09-b93f-fd0192567eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG os_vif [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3e9f491-f2, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa6d75cc-01a3-4c28-8a11-373b78627e90) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: INFO os_vif [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ae:41,bridge_name='br-int',has_traffic_filtering=True,id=f3e9f491-f219-4b09-b93f-fd0192567eef,network=Network(3b56b122-f894-4c5b-a1bd-8e91d4edad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3e9f491-f2')
Oct 23 15:36:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Deleting instance files /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22_del
Oct 23 15:36:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Deletion of /opt/stack/data/nova/instances/a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22_del complete
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:15 user nova-compute[74421]: INFO nova.compute.manager [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Took 1.62 seconds to destroy the instance on the hypervisor.
Oct 23 15:36:15 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:36:15 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:16 user nova-compute[74421]: WARNING nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received unexpected event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with vm_state active and task_state deleting.
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:16 user nova-compute[74421]: WARNING nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state building and task_state spawning.
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:16 user nova-compute[74421]: WARNING nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state building and task_state spawning.
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:16 user nova-compute[74421]: WARNING nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received unexpected event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with vm_state active and task_state deleting.
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:16 user nova-compute[74421]: WARNING nova.compute.manager [req-12677b8b-161d-4946-82fb-756143b4909e req-1b547121-ff4e-4540-abe7-60dc1ba71680 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received unexpected event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with vm_state active and task_state deleting.
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:16 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Took 0.89 seconds to deallocate network for instance.
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8ec973ec-c32f-4792-b608-9589e2f0b49f req-47d78cc9-1cef-4dee-8b24-a57a132f4915 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-deleted-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:16 user nova-compute[74421]: INFO nova.compute.manager [req-8ec973ec-c32f-4792-b608-9589e2f0b49f req-47d78cc9-1cef-4dee-8b24-a57a132f4915 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Neutron deleted interface f3e9f491-f219-4b09-b93f-fd0192567eef; detaching it from the instance and deleting it from the info cache
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.network.neutron [req-8ec973ec-c32f-4792-b608-9589e2f0b49f req-47d78cc9-1cef-4dee-8b24-a57a132f4915 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-8ec973ec-c32f-4792-b608-9589e2f0b49f req-47d78cc9-1cef-4dee-8b24-a57a132f4915 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Detach interface failed, port_id=f3e9f491-f219-4b09-b93f-fd0192567eef, reason: Instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Starting finish_migration {{(pid=74421) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:36:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Creating image(s)
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Ensure instance console log exists: /opt/stack/data/nova/instances/71f11170-4d47-419e-a067-dbc82352a8b9/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Start _get_guest_xml network_info=[{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'dc21f9ba-87b9-4170-9b0a-a4cb00d793dc', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '71f11170-4d47-419e-a067-dbc82352a8b9', 'attached_at': '2023-10-23T15:36:17.000000', 'detached_at': '', 'volume_id': '530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'serial': '530d2ac0-ffa9-453e-8c0d-9b292e1ec395'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:17 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:17 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:36:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:36:17 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:36:17 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:36:17 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Deleted allocations for instance a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2054f4a4-fab3-425f-87d8-2ad9e0c789a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:36:17 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958cdb4-e6da-49c3-a9d6-2a2c494e0e5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395] added
Oct 23 15:36:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b855c2-a685-4e6a-b969-59afdccf02e0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc6986-1ecc-4cb5-bb65-c51ff6f94e68]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMpidyGO {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3fccc5d2-50a6-4fef-a11b-a9678c5ce60c tempest-AttachVolumeNegativeTest-100322526 tempest-AttachVolumeNegativeTest-100322526-project-member] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.355s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMpidyGO" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9bc9ff-9d23-4fc6-aa70-29233434a03f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMpidyGO'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd873a-5ae7-4f2d-a689-723e2b6da7f6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba9684e-3499-4781-901f-582a2150c2a5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df6ab0-f2b2-4b56-bc97-ee0764227ae9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]
Oct 23 15:36:17 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.
Oct 23 15:36:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b543b78b-a9ef-4af8-ae09-493062a05002]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance spawned successfully.
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0a5d5-e685-4f15-9aa8-f9740a262a31]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:17 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:36:17 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7bbdc-7d29-4e89-ab56-45dc7ed2b702]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:36:17 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:36:17 user nova-compute[74421]: INFO nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Took 5.91 seconds to spawn the instance on the hypervisor.
Oct 23 15:36:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:36:18 user nova-compute[74421]: INFO nova.compute.manager [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Took 26.77 seconds to build instance.
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3ed015d-b114-4245-ae0e-ea9a58f1d135 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.902s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:36:18 user nova-compute[74421]: INFO nova.compute.claims [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Claim successful on node user
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-45ec0798-72c1-476b-ac2f-807ec27a6570 req-9fcf3aa2-6c82-4676-9f1e-5f24b8e2b302 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-45ec0798-72c1-476b-ac2f-807ec27a6570 req-9fcf3aa2-6c82-4676-9f1e-5f24b8e2b302 service nova] Acquiring lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-45ec0798-72c1-476b-ac2f-807ec27a6570 req-9fcf3aa2-6c82-4676-9f1e-5f24b8e2b302 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-45ec0798-72c1-476b-ac2f-807ec27a6570 req-9fcf3aa2-6c82-4676-9f1e-5f24b8e2b302 service nova] Lock "a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-45ec0798-72c1-476b-ac2f-807ec27a6570 req-9fcf3aa2-6c82-4676-9f1e-5f24b8e2b302 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] No waiting events found dispatching network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:18 user nova-compute[74421]: WARNING nova.compute.manager [req-45ec0798-72c1-476b-ac2f-807ec27a6570 req-9fcf3aa2-6c82-4676-9f1e-5f24b8e2b302 service nova] [instance: a4faafc9-3a02-4f2d-b4f6-aba57bc1aa22] Received unexpected event network-vif-plugged-f3e9f491-f219-4b09-b93f-fd0192567eef for instance with vm_state deleted and task_state None.
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23234633964653566', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234633964653566', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323723003',display_name='tempest-ServerActionsTestOtherA-server-1323723003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323723003',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:34:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-9v52yphd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=71f11170-4d47-419e-a067-dbc82352a8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:36:18 user nova-compute[74421]:   <uuid>71f11170-4d47-419e-a067-dbc82352a8b9</uuid>
Oct 23 15:36:18 user nova-compute[74421]:   <name>instance-0000001f</name>
Oct 23 15:36:18 user nova-compute[74421]:   <memory>2097152</memory>
Oct 23 15:36:18 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:36:18 user nova-compute[74421]:   <metadata>
Oct 23 15:36:18 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:36:18 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:36:18 user nova-compute[74421]:       <nova:name>tempest-ServerActionsTestOtherA-server-1323723003</nova:name>
Oct 23 15:36:18 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:36:17</nova:creationTime>
Oct 23 15:36:18 user nova-compute[74421]:       <nova:flavor name="m1.small">
Oct 23 15:36:18 user nova-compute[74421]:         <nova:memory>2048</nova:memory>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:disk>20</nova:disk>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:36:18 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:36:18 user nova-compute[74421]:       <nova:owner>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:user uuid="182146bec4cf473ab9e025bca5a74371">tempest-ServerActionsTestOtherA-369604222-project-member</nova:user>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:project uuid="d0053dc54a1e44f18966d687a2bb42e4">tempest-ServerActionsTestOtherA-369604222</nova:project>
Oct 23 15:36:18 user nova-compute[74421]:       </nova:owner>
Oct 23 15:36:18 user nova-compute[74421]:       <nova:ports>
Oct 23 15:36:18 user nova-compute[74421]:         <nova:port uuid="97945e10-06c5-453a-9e05-359a5b48ae0b">
Oct 23 15:36:18 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:36:18 user nova-compute[74421]:         </nova:port>
Oct 23 15:36:18 user nova-compute[74421]:       </nova:ports>
Oct 23 15:36:18 user nova-compute[74421]:     </nova:instance>
Oct 23 15:36:18 user nova-compute[74421]:   </metadata>
Oct 23 15:36:18 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:36:18 user nova-compute[74421]:     <system>
Oct 23 15:36:18 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:36:18 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:36:18 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:36:18 user nova-compute[74421]:       <entry name="serial">71f11170-4d47-419e-a067-dbc82352a8b9</entry>
Oct 23 15:36:18 user nova-compute[74421]:       <entry name="uuid">71f11170-4d47-419e-a067-dbc82352a8b9</entry>
Oct 23 15:36:18 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:36:18 user nova-compute[74421]:     </system>
Oct 23 15:36:18 user nova-compute[74421]:   </sysinfo>
Oct 23 15:36:18 user nova-compute[74421]:   <os>
Oct 23 15:36:18 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:36:18 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:36:18 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:36:18 user nova-compute[74421]:   </os>
Oct 23 15:36:18 user nova-compute[74421]:   <features>
Oct 23 15:36:18 user nova-compute[74421]:     <acpi/>
Oct 23 15:36:18 user nova-compute[74421]:     <apic/>
Oct 23 15:36:18 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:36:18 user nova-compute[74421]:   </features>
Oct 23 15:36:18 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:36:18 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:36:18 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:36:18 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:36:18 user nova-compute[74421]:   </clock>
Oct 23 15:36:18 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:36:18 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:36:18 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:36:18 user nova-compute[74421]:   </cpu>
Oct 23 15:36:18 user nova-compute[74421]:   <devices>
Oct 23 15:36:18 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:36:18 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:36:18 user nova-compute[74421]:       <source dev="/dev/sdd"/>
Oct 23 15:36:18 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:36:18 user nova-compute[74421]:       <serial>530d2ac0-ffa9-453e-8c0d-9b292e1ec395</serial>
Oct 23 15:36:18 user nova-compute[74421]:     </disk>
Oct 23 15:36:18 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:36:18 user nova-compute[74421]:       <mac address="fa:16:3e:88:b3:1d"/>
Oct 23 15:36:18 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:18 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:36:18 user nova-compute[74421]:       <target dev="tap97945e10-06"/>
Oct 23 15:36:18 user nova-compute[74421]:     </interface>
Oct 23 15:36:18 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:36:18 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/71f11170-4d47-419e-a067-dbc82352a8b9/console.log" append="off"/>
Oct 23 15:36:18 user nova-compute[74421]:     </serial>
Oct 23 15:36:18 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:36:18 user nova-compute[74421]:     <video>
Oct 23 15:36:18 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:18 user nova-compute[74421]:     </video>
Oct 23 15:36:18 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:36:18 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:36:18 user nova-compute[74421]:     </rng>
Oct 23 15:36:18 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:36:18 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:36:18 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:36:18 user nova-compute[74421]:     </memballoon>
Oct 23 15:36:18 user nova-compute[74421]:   </devices>
Oct 23 15:36:18 user nova-compute[74421]: </domain>
Oct 23 15:36:18 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323723003',display_name='tempest-ServerActionsTestOtherA-server-1323723003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323723003',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:34:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-9v52yphd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=71f11170-4d47-419e-a067-dbc82352a8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-625546140-network", "vif_mac": "fa:16:3e:88:b3:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG os_vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4249902b-0bf3-5e0c-a685-d78bdfca93fb', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97945e10-06, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97945e10-06, col_values=(('qos', UUID('99fa4964-8b7d-489b-9de7-a9d5a196f241')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97945e10-06, col_values=(('external_ids', {'iface-id': '97945e10-06c5-453a-9e05-359a5b48ae0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b3:1d', 'vm-uuid': '71f11170-4d47-419e-a067-dbc82352a8b9'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:18 user nova-compute[74421]: INFO os_vif [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06')
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:36:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] No VIF found with MAC fa:16:3e:88:b3:1d, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.policy [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84d1dba9a5fa4300b89923bc0bbf4dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39defa9946e1491ab5db08b85f0cb59e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:36:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Creating image(s)
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "/opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "/opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "/opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.232s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk 1073741824" returned: 0 in 0.064s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Successfully created port: df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.257s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Cannot resize image /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Ensure instance console log exists: /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Successfully updated port: df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquired lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-changed-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Refreshing instance network info cache due to event network-changed-df1c298d-0624-406b-b85e-60a6ea65bd88. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:36:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] Acquiring lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-23e31041-86cf-407a-ae44-4b691673683b req-e40575f0-0ace-4906-bf8e-02b3660e1446 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23e31041-86cf-407a-ae44-4b691673683b req-e40575f0-0ace-4906-bf8e-02b3660e1446 service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23e31041-86cf-407a-ae44-4b691673683b req-e40575f0-0ace-4906-bf8e-02b3660e1446 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23e31041-86cf-407a-ae44-4b691673683b req-e40575f0-0ace-4906-bf8e-02b3660e1446 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-23e31041-86cf-407a-ae44-4b691673683b req-e40575f0-0ace-4906-bf8e-02b3660e1446 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:21 user nova-compute[74421]: WARNING nova.compute.manager [req-23e31041-86cf-407a-ae44-4b691673683b req-e40575f0-0ace-4906-bf8e-02b3660e1446 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state active and task_state resize_finish.
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updating instance_info_cache with network_info: [{"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Releasing lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Instance network_info: |[{"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] Acquired lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.neutron [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Refreshing network info cache for port df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Start _get_guest_xml network_info=[{"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:36:21 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:21 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2000968635',display_name='tempest-TestServerVolumeAttachmentScenario-server-2000968635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2000968635',id=34,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/Lu2n2+cXY/SmJPkPJOEYCCrSvQhvSs+rorh0PqAqHKWi+oOd4VIztyojdrt34P4+Em2iFJ9DSWQDvolnvLLT8ZHbtk6VsfcgLY2rrj9GnIRNpVSzZVsopUmsPFgn60Q==',key_name='tempest-keypair-373919674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39defa9946e1491ab5db08b85f0cb59e',ramdisk_id='',reservation_id='r-izc4onnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-238568763',owner_user_name='tempest-TestServerVolumeAttachmentScenario-238568763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84d1dba9a5fa4300b89923bc0bbf4dec',uuid=a741ac42-e881-435c-b7e7-9ea98a9ff132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Converting VIF {"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'pci_devices' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:36:21 user nova-compute[74421]:   <uuid>a741ac42-e881-435c-b7e7-9ea98a9ff132</uuid>
Oct 23 15:36:21 user nova-compute[74421]:   <name>instance-00000022</name>
Oct 23 15:36:21 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:36:21 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:36:21 user nova-compute[74421]:   <metadata>
Oct 23 15:36:21 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:36:21 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:36:21 user nova-compute[74421]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2000968635</nova:name>
Oct 23 15:36:21 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:36:21</nova:creationTime>
Oct 23 15:36:21 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:36:21 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:36:21 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:36:21 user nova-compute[74421]:       <nova:owner>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:user uuid="84d1dba9a5fa4300b89923bc0bbf4dec">tempest-TestServerVolumeAttachmentScenario-238568763-project-member</nova:user>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:project uuid="39defa9946e1491ab5db08b85f0cb59e">tempest-TestServerVolumeAttachmentScenario-238568763</nova:project>
Oct 23 15:36:21 user nova-compute[74421]:       </nova:owner>
Oct 23 15:36:21 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:36:21 user nova-compute[74421]:       <nova:ports>
Oct 23 15:36:21 user nova-compute[74421]:         <nova:port uuid="df1c298d-0624-406b-b85e-60a6ea65bd88">
Oct 23 15:36:21 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 15:36:21 user nova-compute[74421]:         </nova:port>
Oct 23 15:36:21 user nova-compute[74421]:       </nova:ports>
Oct 23 15:36:21 user nova-compute[74421]:     </nova:instance>
Oct 23 15:36:21 user nova-compute[74421]:   </metadata>
Oct 23 15:36:21 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:36:21 user nova-compute[74421]:     <system>
Oct 23 15:36:21 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:36:21 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:36:21 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:36:21 user nova-compute[74421]:       <entry name="serial">a741ac42-e881-435c-b7e7-9ea98a9ff132</entry>
Oct 23 15:36:21 user nova-compute[74421]:       <entry name="uuid">a741ac42-e881-435c-b7e7-9ea98a9ff132</entry>
Oct 23 15:36:21 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:36:21 user nova-compute[74421]:     </system>
Oct 23 15:36:21 user nova-compute[74421]:   </sysinfo>
Oct 23 15:36:21 user nova-compute[74421]:   <os>
Oct 23 15:36:21 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:36:21 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:36:21 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:36:21 user nova-compute[74421]:   </os>
Oct 23 15:36:21 user nova-compute[74421]:   <features>
Oct 23 15:36:21 user nova-compute[74421]:     <acpi/>
Oct 23 15:36:21 user nova-compute[74421]:     <apic/>
Oct 23 15:36:21 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:36:21 user nova-compute[74421]:   </features>
Oct 23 15:36:21 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:36:21 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:36:21 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:36:21 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:36:21 user nova-compute[74421]:   </clock>
Oct 23 15:36:21 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:36:21 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:36:21 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:36:21 user nova-compute[74421]:   </cpu>
Oct 23 15:36:21 user nova-compute[74421]:   <devices>
Oct 23 15:36:21 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:36:21 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:36:21 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk"/>
Oct 23 15:36:21 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:36:21 user nova-compute[74421]:     </disk>
Oct 23 15:36:21 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:36:21 user nova-compute[74421]:       <mac address="fa:16:3e:61:b6:db"/>
Oct 23 15:36:21 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:21 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:36:21 user nova-compute[74421]:       <target dev="tapdf1c298d-06"/>
Oct 23 15:36:21 user nova-compute[74421]:     </interface>
Oct 23 15:36:21 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:36:21 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/console.log" append="off"/>
Oct 23 15:36:21 user nova-compute[74421]:     </serial>
Oct 23 15:36:21 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:36:21 user nova-compute[74421]:     <video>
Oct 23 15:36:21 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:21 user nova-compute[74421]:     </video>
Oct 23 15:36:21 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:36:21 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:36:21 user nova-compute[74421]:     </rng>
Oct 23 15:36:21 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:36:21 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:36:21 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:36:21 user nova-compute[74421]:     </memballoon>
Oct 23 15:36:21 user nova-compute[74421]:   </devices>
Oct 23 15:36:21 user nova-compute[74421]: </domain>
Oct 23 15:36:21 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2000968635',display_name='tempest-TestServerVolumeAttachmentScenario-server-2000968635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2000968635',id=34,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/Lu2n2+cXY/SmJPkPJOEYCCrSvQhvSs+rorh0PqAqHKWi+oOd4VIztyojdrt34P4+Em2iFJ9DSWQDvolnvLLT8ZHbtk6VsfcgLY2rrj9GnIRNpVSzZVsopUmsPFgn60Q==',key_name='tempest-keypair-373919674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39defa9946e1491ab5db08b85f0cb59e',ramdisk_id='',reservation_id='r-izc4onnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-238568763',owner_user_name='tempest-TestServerVolumeAttachmentScenario-238568763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84d1dba9a5fa4300b89923bc0bbf4dec',uuid=a741ac42-e881-435c-b7e7-9ea98a9ff132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Converting VIF {"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG os_vif [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14bed831-75a5-5827-9351-df0a693b2f53', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf1c298d-06, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf1c298d-06, col_values=(('qos', UUID('41f9ad61-0a8d-4ff4-8540-059032858b44')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf1c298d-06, col_values=(('external_ids', {'iface-id': 'df1c298d-0624-406b-b85e-60a6ea65bd88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:b6:db', 'vm-uuid': 'a741ac42-e881-435c-b7e7-9ea98a9ff132'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:21 user nova-compute[74421]: INFO os_vif [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06')
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:36:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No VIF found with MAC fa:16:3e:61:b6:db, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG nova.network.neutron [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updated VIF entry in instance network info cache for port df1c298d-0624-406b-b85e-60a6ea65bd88. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG nova.network.neutron [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updating instance_info_cache with network_info: [{"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ae9f11d2-e585-4c04-ad5d-d523093de888 req-d95211aa-2302-4e39-9532-585625e0be5e service nova] Releasing lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'pci_requests' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'numa_topology' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:36:22 user nova-compute[74421]: INFO nova.compute.claims [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Claim successful on node user
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:36:23 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance running successfully.
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Failed to set time: agent not configured {{(pid=74421) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1b1615b4-df77-430d-93d7-613192611ce4 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] finish_migration finished successfully. {{(pid=74421) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-cb27cb94-f5c5-4501-b8bf-45af28608bc9 req-47019711-def4-409d-b215-5c824b07ac2d service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cb27cb94-f5c5-4501-b8bf-45af28608bc9 req-47019711-def4-409d-b215-5c824b07ac2d service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cb27cb94-f5c5-4501-b8bf-45af28608bc9 req-47019711-def4-409d-b215-5c824b07ac2d service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cb27cb94-f5c5-4501-b8bf-45af28608bc9 req-47019711-def4-409d-b215-5c824b07ac2d service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-cb27cb94-f5c5-4501-b8bf-45af28608bc9 req-47019711-def4-409d-b215-5c824b07ac2d service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:23 user nova-compute[74421]: WARNING nova.compute.manager [req-cb27cb94-f5c5-4501-b8bf-45af28608bc9 req-47019711-def4-409d-b215-5c824b07ac2d service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state resized and task_state None.
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-74cb70ce-d994-4e2d-8e83-8215bf782175 req-efa0214b-233c-4ef8-a6d7-88dd6ca42ed9 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-74cb70ce-d994-4e2d-8e83-8215bf782175 req-efa0214b-233c-4ef8-a6d7-88dd6ca42ed9 service nova] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-74cb70ce-d994-4e2d-8e83-8215bf782175 req-efa0214b-233c-4ef8-a6d7-88dd6ca42ed9 service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-74cb70ce-d994-4e2d-8e83-8215bf782175 req-efa0214b-233c-4ef8-a6d7-88dd6ca42ed9 service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-74cb70ce-d994-4e2d-8e83-8215bf782175 req-efa0214b-233c-4ef8-a6d7-88dd6ca42ed9 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] No waiting events found dispatching network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:23 user nova-compute[74421]: WARNING nova.compute.manager [req-74cb70ce-d994-4e2d-8e83-8215bf782175 req-efa0214b-233c-4ef8-a6d7-88dd6ca42ed9 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received unexpected event network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 for instance with vm_state building and task_state spawning.
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.897s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:23 user nova-compute[74421]: INFO nova.network.neutron [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating port 3275c793-6085-4756-962c-aebd39dc408a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:36:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:36:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG nova.network.neutron [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:36:25 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Creating image(s)
Oct 23 15:36:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'trusted_certs' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG nova.objects.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<a43d4143-17b5-4a95-8e03-3c47568ba3e2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "07ae1568e318fd66732703c45ff2f0368c367522" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "07ae1568e318fd66732703c45ff2f0368c367522" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] No waiting events found dispatching network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:26 user nova-compute[74421]: WARNING nova.compute.manager [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received unexpected event network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 for instance with vm_state building and task_state spawning.
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-changed-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing instance network info cache due to event network-changed-3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] Acquiring lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] Acquired lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Refreshing network info cache for port 3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:36:26 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Instance spawned successfully.
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.virt.images [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] d8dab8c6-c3b2-4438-a5c0-c239cc3dc059 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.part /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:26 user nova-compute[74421]: INFO nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Took 7.28 seconds to spawn the instance on the hypervisor.
Oct 23 15:36:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:36:26 user nova-compute[74421]: INFO nova.compute.manager [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Took 8.56 seconds to build instance.
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6b55dcf7-926f-4718-952d-24b6511b8616 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.713s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.part /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.converted" returned: 0 in 0.447s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updated VIF entry in instance network info cache for port 3275c793-6085-4756-962c-aebd39dc408a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-be78d44d-4d79-439c-86b1-c57188d8c9fc req-3c6ed3a5-4685-4116-98e3-3dbc6b7fe9bb service nova] Releasing lock "refresh_cache-a43d4143-17b5-4a95-8e03-3c47568ba3e2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "07ae1568e318fd66732703c45ff2f0368c367522" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.034s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "07ae1568e318fd66732703c45ff2f0368c367522" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "07ae1568e318fd66732703c45ff2f0368c367522" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522,backing_fmt=raw /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522,backing_fmt=raw /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk 1073741824" returned: 0 in 0.049s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "07ae1568e318fd66732703c45ff2f0368c367522" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'migration_context' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:27 user nova-compute[74421]: DEBUG nova.objects.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<a43d4143-17b5-4a95-8e03-3c47568ba3e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:36:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Rebasing disk image.
Oct 23 15:36:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee -F raw /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee -F raw /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk" returned: 0 in 3.001s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Ensure instance console log exists: /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Start _get_guest_xml network_info=[{"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d719e6e04f3b8908c43aa1cc63b15c44',container_format='bare',created_at=2023-10-23T15:34:09Z,direct_url=<?>,disk_format='qcow2',id=d8dab8c6-c3b2-4438-a5c0-c239cc3dc059,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-571678447-shelved',owner='314ef71af4864309b93505438743151f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': 'e4424aca-03e7-4821-80e4-c432ca419222', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQZTlXyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a43d4143-17b5-4a95-8e03-3c47568ba3e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'eebd686e-2249-4dc9-ad4c-0bda208cae86', 'serial': 'eebd686e-2249-4dc9-ad4c-0bda208cae86'}, 'boot_index': None, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:36:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d719e6e04f3b8908c43aa1cc63b15c44',container_format='bare',created_at=2023-10-23T15:34:09Z,direct_url=<?>,disk_format='qcow2',id=d8dab8c6-c3b2-4438-a5c0-c239cc3dc059,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-571678447-shelved',owner='314ef71af4864309b93505438743151f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'vcpu_model' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.objects.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<a43d4143-17b5-4a95-8e03-3c47568ba3e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQZTlXyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:36:31 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:36:31 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:36:31 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f7c600-79d9-4c0c-9029-fe4d636916c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:36:31 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0d379-152d-4f0c-a91d-4c2ed9da84a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86] added
Oct 23 15:36:31 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[593df858-6b33-49be-9bc6-a47cb97ee38e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1dc7e2-c5bd-49c1-a14f-210323dce8c3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQZTlXyO {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQZTlXyO" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dcf42a-c48c-4126-8e83-1fe43d74500f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQZTlXyO'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba087358-3363-4ecc-a376-1601ecd317e5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[288dd70c-50e0-461e-abb9-d92475747974]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7dc050-540f-4a41-ac64-faac3030c05b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260]
Oct 23 15:36:31 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260] successful.
Oct 23 15:36:31 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f54d2-880b-40d2-a8be-9484a903019c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[84235258-21da-46cb-88be-d802590c131b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)
Oct 23 15:36:31 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[62248c48-1d0b-4823-91ba-7f18951d41c6]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQZTlXyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:36:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23032333630396661', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032333630396661', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-571678447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-571678447',id=28,image_ref='d8dab8c6-c3b2-4438-a5c0-c239cc3dc059',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-91007934',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:32:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-yqousym9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member',shelved_at='2023-10-23T15:34:14.964613',shelved_host='user',shelved_image_id='d8dab8c6-c3b2-4438-a5c0-c239cc3dc059'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=a43d4143-17b5-4a95-8e03-3c47568ba3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'pci_devices' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.objects.base [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<a43d4143-17b5-4a95-8e03-3c47568ba3e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:36:32 user nova-compute[74421]:   <uuid>a43d4143-17b5-4a95-8e03-3c47568ba3e2</uuid>
Oct 23 15:36:32 user nova-compute[74421]:   <name>instance-0000001c</name>
Oct 23 15:36:32 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:36:32 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:36:32 user nova-compute[74421]:   <metadata>
Oct 23 15:36:32 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:36:32 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:36:32 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-571678447</nova:name>
Oct 23 15:36:32 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:36:31</nova:creationTime>
Oct 23 15:36:32 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:36:32 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:36:32 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:36:32 user nova-compute[74421]:       <nova:owner>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:user uuid="6fd182e97e984debb9f71886b04df9bc">tempest-AttachVolumeShelveTestJSON-1510181551-project-member</nova:user>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:project uuid="314ef71af4864309b93505438743151f">tempest-AttachVolumeShelveTestJSON-1510181551</nova:project>
Oct 23 15:36:32 user nova-compute[74421]:       </nova:owner>
Oct 23 15:36:32 user nova-compute[74421]:       <nova:root type="image" uuid="d8dab8c6-c3b2-4438-a5c0-c239cc3dc059"/>
Oct 23 15:36:32 user nova-compute[74421]:       <nova:ports>
Oct 23 15:36:32 user nova-compute[74421]:         <nova:port uuid="3275c793-6085-4756-962c-aebd39dc408a">
Oct 23 15:36:32 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 15:36:32 user nova-compute[74421]:         </nova:port>
Oct 23 15:36:32 user nova-compute[74421]:       </nova:ports>
Oct 23 15:36:32 user nova-compute[74421]:     </nova:instance>
Oct 23 15:36:32 user nova-compute[74421]:   </metadata>
Oct 23 15:36:32 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:36:32 user nova-compute[74421]:     <system>
Oct 23 15:36:32 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:36:32 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:36:32 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:36:32 user nova-compute[74421]:       <entry name="serial">a43d4143-17b5-4a95-8e03-3c47568ba3e2</entry>
Oct 23 15:36:32 user nova-compute[74421]:       <entry name="uuid">a43d4143-17b5-4a95-8e03-3c47568ba3e2</entry>
Oct 23 15:36:32 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:36:32 user nova-compute[74421]:     </system>
Oct 23 15:36:32 user nova-compute[74421]:   </sysinfo>
Oct 23 15:36:32 user nova-compute[74421]:   <os>
Oct 23 15:36:32 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:36:32 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:36:32 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:36:32 user nova-compute[74421]:   </os>
Oct 23 15:36:32 user nova-compute[74421]:   <features>
Oct 23 15:36:32 user nova-compute[74421]:     <acpi/>
Oct 23 15:36:32 user nova-compute[74421]:     <apic/>
Oct 23 15:36:32 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:36:32 user nova-compute[74421]:   </features>
Oct 23 15:36:32 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:36:32 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:36:32 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:36:32 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:36:32 user nova-compute[74421]:   </clock>
Oct 23 15:36:32 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:36:32 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:36:32 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:36:32 user nova-compute[74421]:   </cpu>
Oct 23 15:36:32 user nova-compute[74421]:   <devices>
Oct 23 15:36:32 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:36:32 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:36:32 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk"/>
Oct 23 15:36:32 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:36:32 user nova-compute[74421]:     </disk>
Oct 23 15:36:32 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:36:32 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:36:32 user nova-compute[74421]:       <source dev="/dev/sdf"/>
Oct 23 15:36:32 user nova-compute[74421]:       <target dev="vdc" bus="virtio"/>
Oct 23 15:36:32 user nova-compute[74421]:       <serial>eebd686e-2249-4dc9-ad4c-0bda208cae86</serial>
Oct 23 15:36:32 user nova-compute[74421]:     </disk>
Oct 23 15:36:32 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:36:32 user nova-compute[74421]:       <mac address="fa:16:3e:5e:18:9c"/>
Oct 23 15:36:32 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:32 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:36:32 user nova-compute[74421]:       <target dev="tap3275c793-60"/>
Oct 23 15:36:32 user nova-compute[74421]:     </interface>
Oct 23 15:36:32 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:36:32 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/console.log" append="off"/>
Oct 23 15:36:32 user nova-compute[74421]:     </serial>
Oct 23 15:36:32 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:36:32 user nova-compute[74421]:     <video>
Oct 23 15:36:32 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:36:32 user nova-compute[74421]:     </video>
Oct 23 15:36:32 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:36:32 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:36:32 user nova-compute[74421]:     </rng>
Oct 23 15:36:32 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:36:32 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:36:32 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:36:32 user nova-compute[74421]:     </memballoon>
Oct 23 15:36:32 user nova-compute[74421]:   </devices>
Oct 23 15:36:32 user nova-compute[74421]: </domain>
Oct 23 15:36:32 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-571678447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-571678447',id=28,image_ref='d8dab8c6-c3b2-4438-a5c0-c239cc3dc059',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-91007934',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:32:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-yqousym9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member',shelved_at='2023-10-23T15:34:14.964613',shelved_host='user',shelved_image_id='d8dab8c6-c3b2-4438-a5c0-c239cc3dc059'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=a43d4143-17b5-4a95-8e03-3c47568ba3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG os_vif [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93fbeaa9-189f-54cf-9032-5c6a5af12ff9', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3275c793-60, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3275c793-60, col_values=(('qos', UUID('521cb804-fa96-41c1-b21c-b5465a47dcc2')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3275c793-60, col_values=(('external_ids', {'iface-id': '3275c793-6085-4756-962c-aebd39dc408a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:18:9c', 'vm-uuid': 'a43d4143-17b5-4a95-8e03-3c47568ba3e2'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:32 user nova-compute[74421]: INFO os_vif [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60')
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:36:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No VIF found with MAC fa:16:3e:5e:18:9c, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9680bc7-8354-4da5-84b8-17063439eaf8 req-2544a0c0-eea3-4ebb-8423-17472c09d5bc service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9680bc7-8354-4da5-84b8-17063439eaf8 req-2544a0c0-eea3-4ebb-8423-17472c09d5bc service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9680bc7-8354-4da5-84b8-17063439eaf8 req-2544a0c0-eea3-4ebb-8423-17472c09d5bc service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f9680bc7-8354-4da5-84b8-17063439eaf8 req-2544a0c0-eea3-4ebb-8423-17472c09d5bc service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-f9680bc7-8354-4da5-84b8-17063439eaf8 req-2544a0c0-eea3-4ebb-8423-17472c09d5bc service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:34 user nova-compute[74421]: WARNING nova.compute.manager [req-f9680bc7-8354-4da5-84b8-17063439eaf8 req-2544a0c0-eea3-4ebb-8423-17472c09d5bc service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 15:36:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-27868937-18f9-424c-a992-de881a21beb0 req-d907433d-0c03-468e-8c14-d7a11843a1f2 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-27868937-18f9-424c-a992-de881a21beb0 req-d907433d-0c03-468e-8c14-d7a11843a1f2 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-27868937-18f9-424c-a992-de881a21beb0 req-d907433d-0c03-468e-8c14-d7a11843a1f2 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-27868937-18f9-424c-a992-de881a21beb0 req-d907433d-0c03-468e-8c14-d7a11843a1f2 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-27868937-18f9-424c-a992-de881a21beb0 req-d907433d-0c03-468e-8c14-d7a11843a1f2 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:36:36 user nova-compute[74421]: WARNING nova.compute.manager [req-27868937-18f9-424c-a992-de881a21beb0 req-d907433d-0c03-468e-8c14-d7a11843a1f2 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 15:36:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:36:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:36:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance spawned successfully.
Oct 23 15:36:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:36:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f3713f58-d7d0-4eab-83e6-9d5fca2f7f34 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.235s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:36:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing instance network info cache due to event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:36:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:36:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:36:39 user nova-compute[74421]: DEBUG nova.network.neutron [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:36:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updated VIF entry in instance network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:36:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a59bd158-3673-4d43-b3a1-1d974d0bc9b8 req-83bb1c4e-6203-4c5a-ad66-bc1c37ee7c4a service nova] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:36:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:36:41 user nova-compute[74421]: INFO nova.compute.manager [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] instance snapshotting
Oct 23 15:36:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Beginning live snapshot process
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx5djdr8e/85ddfc87fee945848e79236b01d5f4e5.delta 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx5djdr8e/85ddfc87fee945848e79236b01d5f4e5.delta 1073741824" returned: 0 in 0.056s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 15:36:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:36:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] COPY block job progress, current cursor: 47841280 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:36:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:36:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 15:36:44 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:36:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx5djdr8e/85ddfc87fee945848e79236b01d5f4e5.delta /opt/stack/data/nova/instances/snapshots/tmpx5djdr8e/85ddfc87fee945848e79236b01d5f4e5 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx5djdr8e/85ddfc87fee945848e79236b01d5f4e5.delta /opt/stack/data/nova/instances/snapshots/tmpx5djdr8e/85ddfc87fee945848e79236b01d5f4e5" returned: 0 in 0.792s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:45 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Snapshot extracted, beginning image upload
Oct 23 15:36:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:36:45 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 797f85e1-87ce-4295-8e14-19fd0919f2a0 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [{"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-797f85e1-87ce-4295-8e14-19fd0919f2a0" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:36:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:48 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Snapshot image upload complete
Oct 23 15:36:48 user nova-compute[74421]: INFO nova.compute.manager [None req-08be35c6-6e41-42dd-9023-27a91e0991d1 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Took 6.87 seconds to snapshot the instance on the hypervisor.
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:36:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:36:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7219MB free_disk=24.901912689208984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Applying migration context for instance 71f11170-4d47-419e-a067-dbc82352a8b9 as it has an incoming, in-progress migration 57b5c93d-c837-486c-8d95-6759bcc98547. Migration status is finished {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 15:36:51 user nova-compute[74421]: INFO nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating resource usage from migration 57b5c93d-c837-486c-8d95-6759bcc98547
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8e63a09b-624d-4bf2-8d8a-77225bd34a8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Migration 57b5c93d-c837-486c-8d95-6759bcc98547 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 71f11170-4d47-419e-a067-dbc82352a8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a741ac42-e881-435c-b7e7-9ea98a9ff132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:36:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:36:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:36:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:36:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:36:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:36:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:36:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:04 user nova-compute[74421]: INFO nova.compute.manager [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Unrescuing
Oct 23 15:37:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquired lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating instance_info_cache with network_info: [{"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Releasing lock "refresh_cache-d1ad1db4-d19c-42d6-a7af-3296b6c7c461" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'flavor' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-e98001e2-83c9-4865-9240-0c40c9a9ed2d req-2fe43d9d-cf57-4bd2-9ffb-1ad0af291ede service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e98001e2-83c9-4865-9240-0c40c9a9ed2d req-2fe43d9d-cf57-4bd2-9ffb-1ad0af291ede service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e98001e2-83c9-4865-9240-0c40c9a9ed2d req-2fe43d9d-cf57-4bd2-9ffb-1ad0af291ede service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e98001e2-83c9-4865-9240-0c40c9a9ed2d req-2fe43d9d-cf57-4bd2-9ffb-1ad0af291ede service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-e98001e2-83c9-4865-9240-0c40c9a9ed2d req-2fe43d9d-cf57-4bd2-9ffb-1ad0af291ede service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:05 user nova-compute[74421]: WARNING nova.compute.manager [req-e98001e2-83c9-4865-9240-0c40c9a9ed2d req-2fe43d9d-cf57-4bd2-9ffb-1ad0af291ede service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:37:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance destroyed successfully.
Oct 23 15:37:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:07 user nova-compute[74421]: WARNING nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:37:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:07 user nova-compute[74421]: WARNING nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:37:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:07 user nova-compute[74421]: WARNING nova.compute.manager [req-52224f94-7fec-427b-9acf-6e26fb413e1c req-32c49752-501a-49ee-afb6-305cb7f00417 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:37:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8049f295-540d-4eb6-8ba4-290a545b7354 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:37:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:37:28 user nova-compute[74421]: INFO nova.compute.claims [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Claim successful on node user
Oct 23 15:37:28 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:37:28 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:37:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.policy [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5629aa90fa4b40b4886cb46dc21e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ed209b95549e8a0d77ead103b1c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:37:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Creating image(s)
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk 1073741824" returned: 0 in 0.049s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Successfully created port: 01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:37:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Cannot resize image /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Ensure instance console log exists: /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Successfully updated port: 01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing instance network info cache due to event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance network_info: |[{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Start _get_guest_xml network_info=[{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:37:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:37:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827231928',display_name='tempest-ServerRescueNegativeTestJSON-server-827231928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827231928',id=35,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8MdfSc5yON++t/AhakxtvmgxaNarlEI8Y5Bh9DMvYe9b/V9EZ2FEFc/eLDRPIcZ9oKQGvW6cYoDO1i6g421BLgXOwmCn0Ex+IXTAnYeDleENYS3/rdAUK1BU5vAFWJPQ==',key_name='tempest-keypair-1566777487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-5hg9m7at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=146c13ae-a37f-406d-8dc6-13f0413efdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'pci_devices' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:37:31 user nova-compute[74421]:   <uuid>146c13ae-a37f-406d-8dc6-13f0413efdae</uuid>
Oct 23 15:37:31 user nova-compute[74421]:   <name>instance-00000023</name>
Oct 23 15:37:31 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:37:31 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:37:31 user nova-compute[74421]:   <metadata>
Oct 23 15:37:31 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:37:31 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:37:31 user nova-compute[74421]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-827231928</nova:name>
Oct 23 15:37:31 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:37:31</nova:creationTime>
Oct 23 15:37:31 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:37:31 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:37:31 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:37:31 user nova-compute[74421]:       <nova:owner>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:user uuid="6b5629aa90fa4b40b4886cb46dc21e65">tempest-ServerRescueNegativeTestJSON-1858635885-project-member</nova:user>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:project uuid="db8ed209b95549e8a0d77ead103b1c1a">tempest-ServerRescueNegativeTestJSON-1858635885</nova:project>
Oct 23 15:37:31 user nova-compute[74421]:       </nova:owner>
Oct 23 15:37:31 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:37:31 user nova-compute[74421]:       <nova:ports>
Oct 23 15:37:31 user nova-compute[74421]:         <nova:port uuid="01e85c82-ce95-4efc-b892-7195d64b52c8">
Oct 23 15:37:31 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:37:31 user nova-compute[74421]:         </nova:port>
Oct 23 15:37:31 user nova-compute[74421]:       </nova:ports>
Oct 23 15:37:31 user nova-compute[74421]:     </nova:instance>
Oct 23 15:37:31 user nova-compute[74421]:   </metadata>
Oct 23 15:37:31 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:37:31 user nova-compute[74421]:     <system>
Oct 23 15:37:31 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:37:31 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:37:31 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:37:31 user nova-compute[74421]:       <entry name="serial">146c13ae-a37f-406d-8dc6-13f0413efdae</entry>
Oct 23 15:37:31 user nova-compute[74421]:       <entry name="uuid">146c13ae-a37f-406d-8dc6-13f0413efdae</entry>
Oct 23 15:37:31 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:37:31 user nova-compute[74421]:     </system>
Oct 23 15:37:31 user nova-compute[74421]:   </sysinfo>
Oct 23 15:37:31 user nova-compute[74421]:   <os>
Oct 23 15:37:31 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:37:31 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:37:31 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:37:31 user nova-compute[74421]:   </os>
Oct 23 15:37:31 user nova-compute[74421]:   <features>
Oct 23 15:37:31 user nova-compute[74421]:     <acpi/>
Oct 23 15:37:31 user nova-compute[74421]:     <apic/>
Oct 23 15:37:31 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:37:31 user nova-compute[74421]:   </features>
Oct 23 15:37:31 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:37:31 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:37:31 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:37:31 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:37:31 user nova-compute[74421]:   </clock>
Oct 23 15:37:31 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:37:31 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:37:31 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:37:31 user nova-compute[74421]:   </cpu>
Oct 23 15:37:31 user nova-compute[74421]:   <devices>
Oct 23 15:37:31 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:37:31 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:37:31 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk"/>
Oct 23 15:37:31 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:37:31 user nova-compute[74421]:     </disk>
Oct 23 15:37:31 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:37:31 user nova-compute[74421]:       <mac address="fa:16:3e:3b:13:c0"/>
Oct 23 15:37:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:37:31 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:37:31 user nova-compute[74421]:       <target dev="tap01e85c82-ce"/>
Oct 23 15:37:31 user nova-compute[74421]:     </interface>
Oct 23 15:37:31 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:37:31 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/console.log" append="off"/>
Oct 23 15:37:31 user nova-compute[74421]:     </serial>
Oct 23 15:37:31 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:37:31 user nova-compute[74421]:     <video>
Oct 23 15:37:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:37:31 user nova-compute[74421]:     </video>
Oct 23 15:37:31 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:37:31 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:37:31 user nova-compute[74421]:     </rng>
Oct 23 15:37:31 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:37:31 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:37:31 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:37:31 user nova-compute[74421]:     </memballoon>
Oct 23 15:37:31 user nova-compute[74421]:   </devices>
Oct 23 15:37:31 user nova-compute[74421]: </domain>
Oct 23 15:37:31 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827231928',display_name='tempest-ServerRescueNegativeTestJSON-server-827231928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827231928',id=35,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8MdfSc5yON++t/AhakxtvmgxaNarlEI8Y5Bh9DMvYe9b/V9EZ2FEFc/eLDRPIcZ9oKQGvW6cYoDO1i6g421BLgXOwmCn0Ex+IXTAnYeDleENYS3/rdAUK1BU5vAFWJPQ==',key_name='tempest-keypair-1566777487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-5hg9m7at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=146c13ae-a37f-406d-8dc6-13f0413efdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG os_vif [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'efe1e052-4a57-5c0a-ac8b-c28d4bda240f', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01e85c82-ce, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01e85c82-ce, col_values=(('qos', UUID('10c82d26-0463-44ca-9457-103d0d0dda7c')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01e85c82-ce, col_values=(('external_ids', {'iface-id': '01e85c82-ce95-4efc-b892-7195d64b52c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:13:c0', 'vm-uuid': '146c13ae-a37f-406d-8dc6-13f0413efdae'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:31 user nova-compute[74421]: INFO os_vif [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce')
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:3b:13:c0, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updated VIF entry in instance network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9cd470af-164e-461b-b7b3-a5d4dcc20f43 req-a412fee2-8e9a-4335-b446-5c18be162e66 service nova] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-3af14a84-8a1f-4fee-afab-22b8070bcdcb req-f50497ee-31a4-437c-bee4-e44e803096b5 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3af14a84-8a1f-4fee-afab-22b8070bcdcb req-f50497ee-31a4-437c-bee4-e44e803096b5 service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3af14a84-8a1f-4fee-afab-22b8070bcdcb req-f50497ee-31a4-437c-bee4-e44e803096b5 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3af14a84-8a1f-4fee-afab-22b8070bcdcb req-f50497ee-31a4-437c-bee4-e44e803096b5 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-3af14a84-8a1f-4fee-afab-22b8070bcdcb req-f50497ee-31a4-437c-bee4-e44e803096b5 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:32 user nova-compute[74421]: WARNING nova.compute.manager [req-3af14a84-8a1f-4fee-afab-22b8070bcdcb req-f50497ee-31a4-437c-bee4-e44e803096b5 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state building and task_state spawning.
Oct 23 15:37:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:37:34 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance spawned successfully.
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-6db8bf16-13cb-451e-b5de-670753295995 req-f9ac2b61-50d7-4668-9e96-0d0e4f4e6f30 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6db8bf16-13cb-451e-b5de-670753295995 req-f9ac2b61-50d7-4668-9e96-0d0e4f4e6f30 service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6db8bf16-13cb-451e-b5de-670753295995 req-f9ac2b61-50d7-4668-9e96-0d0e4f4e6f30 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6db8bf16-13cb-451e-b5de-670753295995 req-f9ac2b61-50d7-4668-9e96-0d0e4f4e6f30 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-6db8bf16-13cb-451e-b5de-670753295995 req-f9ac2b61-50d7-4668-9e96-0d0e4f4e6f30 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:34 user nova-compute[74421]: WARNING nova.compute.manager [req-6db8bf16-13cb-451e-b5de-670753295995 req-f9ac2b61-50d7-4668-9e96-0d0e4f4e6f30 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state building and task_state spawning.
Oct 23 15:37:34 user nova-compute[74421]: INFO nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 23 15:37:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:37:35 user nova-compute[74421]: INFO nova.compute.manager [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Took 6.64 seconds to build instance.
Oct 23 15:37:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a6344cad-3a8b-43b1-a640-9e372f47278b tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.812s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Going to confirm migration 2 {{(pid=74421) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquired lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:37:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'info_cache' on Instance uuid 71f11170-4d47-419e-a067-dbc82352a8b9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG nova.network.neutron [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [{"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Releasing lock "refresh_cache-71f11170-4d47-419e-a067-dbc82352a8b9" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'migration_context' on Instance uuid 71f11170-4d47-419e-a067-dbc82352a8b9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG nova.objects.base [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Object Instance<71f11170-4d47-419e-a067-dbc82352a8b9> lazy-loaded attributes: info_cache,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing instance network info cache due to event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:43 user nova-compute[74421]: DEBUG nova.network.neutron [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.737s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:44 user nova-compute[74421]: INFO nova.compute.manager [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Shelve offloading
Oct 23 15:37:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:44 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Deleted allocation for migration 57b5c93d-c837-486c-8d95-6759bcc98547
Oct 23 15:37:44 user nova-compute[74421]: DEBUG nova.network.neutron [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updated VIF entry in instance network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG nova.network.neutron [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f8653eb-1bcb-483e-a85f-e0cd74c3ae3b req-ed527d15-9d85-4cf2-9eea-527e2c811c05 service nova] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-780f99b8-251a-4ec4-bc9c-fadc11acb751 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.410s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:45 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance destroyed successfully.
Oct 23 15:37:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:37:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-unplugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-unplugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:46 user nova-compute[74421]: WARNING nova.compute.manager [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-unplugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state active and task_state shelving.
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:37:46 user nova-compute[74421]: WARNING nova.compute.manager [req-aed5f994-8be2-44c6-b738-2e026beeff4a req-3d92f0ed-34c7-4673-ba83-38702d4c84f3 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state active and task_state shelving.
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updating instance_info_cache with network_info: [{"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-83da5c9e-eac9-4f74-9c0c-b003b475415a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:37:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance destroyed successfully.
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'resources' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-474494279',display_name='tempest-TestShelveInstance-server-474494279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-474494279',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2OSiezPrLZHl4M39rxTh4qzpR3tldswq9wUaxP32WtQzURZCFBfLo5or+FYD0CFK6Nr18rS+/72Nw2QBDKxhjBDBOTPBSHsIIW1MzcCQGZvyIkgzlnKvEKOJaFxfdlw==',key_name='tempest-TestShelveInstance-1680132638',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:36:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79f5d845cfc547f69e20081a6e42c3eb',ramdisk_id='',reservation_id='r-86c22pno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1665380191',owner_user_name='tempest-TestShelveInstance-1665380191-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:36:18Z,user_data=None,user_id='cac7200691824d7ca5a62ae55959832d',uuid=8e63a09b-624d-4bf2-8d8a-77225bd34a8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converting VIF {"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_vif [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing instance network info cache due to event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.network.neutron [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc99a03a6-43, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06a5a435-98c0-4b24-9cf0-aacf24b5f7f3) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:46 user nova-compute[74421]: INFO os_vif [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43')
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:37:46 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9154681-9b42-40ae-987f-73b7a25cc681]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:37:46 user nova-compute[74421]: No targets found.
Oct 23 15:37:46 user nova-compute[74421]: iSNS:
Oct 23 15:37:46 user nova-compute[74421]: No targets found.
Oct 23 15:37:46 user nova-compute[74421]: STATIC:
Oct 23 15:37:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:37:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:37:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:37:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86
Oct 23 15:37:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:37:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:37:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067
Oct 23 15:37:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:37:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:37:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:37:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:37:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:37:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c
Oct 23 15:37:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:37:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:37:46 user nova-compute[74421]: FIRMWARE:
Oct 23 15:37:46 user nova-compute[74421]: No targets found.
Oct 23 15:37:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:37:46 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:37:46 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9490961-473b-4823-94fb-44a3e4e7936d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd871b9a-2d35-4714-8b97-e05a1a4baf65]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)
Oct 23 15:37:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24800b1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9b57e-49ec-460f-993f-2d68843e3aa4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc8b12-5f16-468d-800b-46341506cfda]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df533123-c2c2-4b99-af6a-babe971844bf]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d0313a-1e65-430e-8091-f428a5cc6d93]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ccc6a5-5c05-4674-8e28-3bb388bc32fb]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e8f251-1a08-4c32-bdb7-1bf017d32411]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]
Oct 23 15:37:46 user nova-compute[74421]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.
Oct 23 15:37:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b167c-618d-4ec7-961f-89cc0cf18afe]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] <== disconnect_volume: return (361ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:37:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Deleting instance files /opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d_del
Oct 23 15:37:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Deletion of /opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d_del complete
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.network.neutron [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updated VIF entry in instance network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG nova.network.neutron [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": null, "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc99a03a6-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:37:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4563cfcf-35fc-432f-be10-58eb6225db35 req-655ffd21-dab4-4ab4-b5d7-1fd03494fa31 service nova] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:37:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:47 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Deleted allocations for instance 8e63a09b-624d-4bf2-8d8a-77225bd34a8d
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG nova.objects.base [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Object Instance<8e63a09b-624d-4bf2-8d8a-77225bd34a8d> lazy-loaded attributes: resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d51b0269-5f0b-4cd3-bedb-f1d3114bfa83 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.143s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:37:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:37:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:37:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:37:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:37:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7231MB free_disk=24.896697998046875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:37:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 71f11170-4d47-419e-a067-dbc82352a8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a741ac42-e881-435c-b7e7-9ea98a9ff132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:37:52 user nova-compute[74421]: INFO nova.compute.manager [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Detaching volume eebd686e-2249-4dc9-ad4c-0bda208cae86
Oct 23 15:37:52 user nova-compute[74421]: INFO nova.virt.block_device [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Attempting to driver detach volume eebd686e-2249-4dc9-ad4c-0bda208cae86 from mountpoint /dev/vdc
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Attempting to detach device vdc from instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:37:52 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:37:52 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:37:52 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:37:52 user nova-compute[74421]:   <serial>eebd686e-2249-4dc9-ad4c-0bda208cae86</serial>
Oct 23 15:37:52 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 15:37:52 user nova-compute[74421]: </disk>
Oct 23 15:37:52 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:37:52 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully detached device vdc from instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 from the persistent domain config.
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:37:52 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:37:52 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:37:52 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:37:52 user nova-compute[74421]:   <serial>eebd686e-2249-4dc9-ad4c-0bda208cae86</serial>
Oct 23 15:37:52 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 15:37:52 user nova-compute[74421]: </disk>
Oct 23 15:37:52 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.006s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:37:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:37:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:37:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:37:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:38:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:38:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:08 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:38:08 user nova-compute[74421]: INFO nova.compute.claims [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Claim successful on node user
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-changed-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Refreshing instance network info cache due to event network-changed-df1c298d-0624-406b-b85e-60a6ea65bd88. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] Acquiring lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] Acquired lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.network.neutron [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Refreshing network info cache for port df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:38:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.policy [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f04beb9793444f0a92dcad598ce6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4434fbc6814bbb9fe2c48ed84f4a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:38:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Creating image(s)
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "/opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "/opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "/opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.network.neutron [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updated VIF entry in instance network info cache for port df1c298d-0624-406b-b85e-60a6ea65bd88. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG nova.network.neutron [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updating instance_info_cache with network_info: [{"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-59c37995-f67b-482e-a766-8c8ad822a936 req-8252f723-673d-425b-b0de-427ceae47495 service nova] Releasing lock "refresh_cache-a741ac42-e881-435c-b7e7-9ea98a9ff132" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk 1073741824" returned: 0 in 0.061s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Successfully created port: 6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.objects.instance [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'flavor' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Cannot resize image /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Ensure instance console log exists: /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:10 user nova-compute[74421]: INFO nova.compute.manager [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attaching volume d001a819-a587-430a-a818-3b996cb6d03b to /dev/vdb
Oct 23 15:38:10 user nova-compute[74421]: DEBUG os_brick.utils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f569e96-f1f1-479d-b6db-b5843b19f0ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcff8ac-24cd-44e4-b6f5-e3b1736f21cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e026498-5701-48e3-b561-44a437e27e08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5694af7-83d9-415c-8ee8-b6a191f47ade]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:38:10 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5d160a-1010-44de-b91b-1d3fd9d0403d]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG os_brick.utils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updating existing volume attachment record: 94d1548c-d44f-444e-9032-8df4dc3d754c {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Successfully updated port: 6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquired lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-changed-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Refreshing instance network info cache due to event network-changed-6d29cd30-7b4c-4af3-a083-be2db7680c00. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] Acquiring lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:38:10 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updating instance_info_cache with network_info: [{"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Releasing lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Instance network_info: |[{"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] Acquired lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Refreshing network info cache for port 6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Start _get_guest_xml network_info=[{"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:38:11 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:38:11 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1263149479',display_name='tempest-VolumesSnapshotTestJSON-instance-1263149479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1263149479',id=36,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr6nDOWx8Abwi/IW5zvQ9QU2hb3zm4OdcoYmgD6nHgLI+Hal7ivs4QUGgC8+a+MozsLnbKaY8awb9r55+INvQelEETSeDVDA9hHXYss9BXY424TQhLYwSCepHVm6LVzXA==',key_name='tempest-keypair-1455470655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4434fbc6814bbb9fe2c48ed84f4a38',ramdisk_id='',reservation_id='r-ssgoxpl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-461344925',owner_user_name='tempest-VolumesSnapshotTestJSON-461344925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:38:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f04beb9793444f0a92dcad598ce6533',uuid=794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converting VIF {"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'pci_devices' on Instance uuid 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:38:11 user nova-compute[74421]:   <uuid>794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e</uuid>
Oct 23 15:38:11 user nova-compute[74421]:   <name>instance-00000024</name>
Oct 23 15:38:11 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:38:11 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:38:11 user nova-compute[74421]:   <metadata>
Oct 23 15:38:11 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:38:11 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:38:11 user nova-compute[74421]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1263149479</nova:name>
Oct 23 15:38:11 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:38:11</nova:creationTime>
Oct 23 15:38:11 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:38:11 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:38:11 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:38:11 user nova-compute[74421]:       <nova:owner>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:user uuid="2f04beb9793444f0a92dcad598ce6533">tempest-VolumesSnapshotTestJSON-461344925-project-member</nova:user>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:project uuid="2e4434fbc6814bbb9fe2c48ed84f4a38">tempest-VolumesSnapshotTestJSON-461344925</nova:project>
Oct 23 15:38:11 user nova-compute[74421]:       </nova:owner>
Oct 23 15:38:11 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:38:11 user nova-compute[74421]:       <nova:ports>
Oct 23 15:38:11 user nova-compute[74421]:         <nova:port uuid="6d29cd30-7b4c-4af3-a083-be2db7680c00">
Oct 23 15:38:11 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 15:38:11 user nova-compute[74421]:         </nova:port>
Oct 23 15:38:11 user nova-compute[74421]:       </nova:ports>
Oct 23 15:38:11 user nova-compute[74421]:     </nova:instance>
Oct 23 15:38:11 user nova-compute[74421]:   </metadata>
Oct 23 15:38:11 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:38:11 user nova-compute[74421]:     <system>
Oct 23 15:38:11 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:38:11 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:38:11 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:38:11 user nova-compute[74421]:       <entry name="serial">794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e</entry>
Oct 23 15:38:11 user nova-compute[74421]:       <entry name="uuid">794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e</entry>
Oct 23 15:38:11 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:38:11 user nova-compute[74421]:     </system>
Oct 23 15:38:11 user nova-compute[74421]:   </sysinfo>
Oct 23 15:38:11 user nova-compute[74421]:   <os>
Oct 23 15:38:11 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:38:11 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:38:11 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:38:11 user nova-compute[74421]:   </os>
Oct 23 15:38:11 user nova-compute[74421]:   <features>
Oct 23 15:38:11 user nova-compute[74421]:     <acpi/>
Oct 23 15:38:11 user nova-compute[74421]:     <apic/>
Oct 23 15:38:11 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:38:11 user nova-compute[74421]:   </features>
Oct 23 15:38:11 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:38:11 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:38:11 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:38:11 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:38:11 user nova-compute[74421]:   </clock>
Oct 23 15:38:11 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:38:11 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:38:11 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:38:11 user nova-compute[74421]:   </cpu>
Oct 23 15:38:11 user nova-compute[74421]:   <devices>
Oct 23 15:38:11 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:38:11 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:38:11 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk"/>
Oct 23 15:38:11 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:38:11 user nova-compute[74421]:     </disk>
Oct 23 15:38:11 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:38:11 user nova-compute[74421]:       <mac address="fa:16:3e:d4:ad:f9"/>
Oct 23 15:38:11 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:38:11 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:38:11 user nova-compute[74421]:       <target dev="tap6d29cd30-7b"/>
Oct 23 15:38:11 user nova-compute[74421]:     </interface>
Oct 23 15:38:11 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:38:11 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/console.log" append="off"/>
Oct 23 15:38:11 user nova-compute[74421]:     </serial>
Oct 23 15:38:11 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:38:11 user nova-compute[74421]:     <video>
Oct 23 15:38:11 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:38:11 user nova-compute[74421]:     </video>
Oct 23 15:38:11 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:38:11 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:38:11 user nova-compute[74421]:     </rng>
Oct 23 15:38:11 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:38:11 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:38:11 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:38:11 user nova-compute[74421]:     </memballoon>
Oct 23 15:38:11 user nova-compute[74421]:   </devices>
Oct 23 15:38:11 user nova-compute[74421]: </domain>
Oct 23 15:38:11 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1263149479',display_name='tempest-VolumesSnapshotTestJSON-instance-1263149479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1263149479',id=36,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr6nDOWx8Abwi/IW5zvQ9QU2hb3zm4OdcoYmgD6nHgLI+Hal7ivs4QUGgC8+a+MozsLnbKaY8awb9r55+INvQelEETSeDVDA9hHXYss9BXY424TQhLYwSCepHVm6LVzXA==',key_name='tempest-keypair-1455470655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4434fbc6814bbb9fe2c48ed84f4a38',ramdisk_id='',reservation_id='r-ssgoxpl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-461344925',owner_user_name='tempest-VolumesSnapshotTestJSON-461344925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:38:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f04beb9793444f0a92dcad598ce6533',uuid=794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converting VIF {"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG os_vif [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac2faee5-22ea-5d5c-b348-0957c94dd669', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d29cd30-7b, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d29cd30-7b, col_values=(('qos', UUID('f9f795fe-6a46-4666-99a8-6dc50764ae6e')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d29cd30-7b, col_values=(('external_ids', {'iface-id': '6d29cd30-7b4c-4af3-a083-be2db7680c00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:ad:f9', 'vm-uuid': '794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:11 user nova-compute[74421]: INFO os_vif [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b')
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No VIF found with MAC fa:16:3e:d4:ad:f9, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updated VIF entry in instance network info cache for port 6d29cd30-7b4c-4af3-a083-be2db7680c00. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updating instance_info_cache with network_info: [{"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-98a02dbc-8db2-4f9a-bcd5-91354c377d35 req-6e0c3d79-7ee8-4f08-89cc-a6c5bc62061b service nova] Releasing lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 is timed out.
Oct 23 15:38:12 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully detached device vdc from instance a43d4143-17b5-4a95-8e03-3c47568ba3e2 from the live domain config.
Oct 23 15:38:12 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQZTlXyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:12 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f042b2c-1595-4bdb-ba6e-decedbe1363c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:38:12 user nova-compute[74421]: No targets found.
Oct 23 15:38:12 user nova-compute[74421]: iSNS:
Oct 23 15:38:12 user nova-compute[74421]: No targets found.
Oct 23 15:38:12 user nova-compute[74421]: STATIC:
Oct 23 15:38:12 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:38:12 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:12 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:12 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86
Oct 23 15:38:12 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:12 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:12 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067
Oct 23 15:38:12 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:12 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:12 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:38:12 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:12 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:12 user nova-compute[74421]: FIRMWARE:
Oct 23 15:38:12 user nova-compute[74421]: No targets found.
Oct 23 15:38:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:38:12 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:38:12 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37b6bff-c7ad-4da8-b61d-5d39bef05a34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab3a839-a1f3-4214-bed9-aec8afa5fa41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 (non-flash)
Oct 23 15:38:12 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247857e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86'): ({'sdf'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Removing single pathed devices sdf {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e4753f-d160-411d-9429-d9087aa50a6e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd91b6-eaa4-4ba6-8c39-458bdd9d74e0]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flushing IO for device /dev/sdf {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-70361cf6-8b1d-4b75-8d12-c5ccba927f97 req-404d45da-5cc0-408f-b31e-89636af8a666 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-70361cf6-8b1d-4b75-8d12-c5ccba927f97 req-404d45da-5cc0-408f-b31e-89636af8a666 service nova] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-70361cf6-8b1d-4b75-8d12-c5ccba927f97 req-404d45da-5cc0-408f-b31e-89636af8a666 service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-70361cf6-8b1d-4b75-8d12-c5ccba927f97 req-404d45da-5cc0-408f-b31e-89636af8a666 service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-70361cf6-8b1d-4b75-8d12-c5ccba927f97 req-404d45da-5cc0-408f-b31e-89636af8a666 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] No waiting events found dispatching network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:12 user nova-compute[74421]: WARNING nova.compute.manager [req-70361cf6-8b1d-4b75-8d12-c5ccba927f97 req-404d45da-5cc0-408f-b31e-89636af8a666 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received unexpected event network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 for instance with vm_state building and task_state spawning.
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e21ca5b-cb71-4309-9117-9356872866e5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:38:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f871e1-3dc8-4217-b41e-feebc34f95c8]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a21a6cc-22a9-440d-8e57-57c3035dde1d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f2292-9890-4400-8934-e8a61cb4c631]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260]
Oct 23 15:38:13 user nova-compute[74421]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86, portal: 172.16.0.220,3260] successful.
Oct 23 15:38:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eebd686e-2249-4dc9-ad4c-0bda208cae86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b66c9-b055-4987-8e60-fe38f5178ef3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] <== disconnect_volume: return (389ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-055f3c2e-8d60-4f1b-876d-f927d85bdbdd req-651c03d3-bf34-45ab-8ce2-31a570ceb27e service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-055f3c2e-8d60-4f1b-876d-f927d85bdbdd req-651c03d3-bf34-45ab-8ce2-31a570ceb27e service nova] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-055f3c2e-8d60-4f1b-876d-f927d85bdbdd req-651c03d3-bf34-45ab-8ce2-31a570ceb27e service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-055f3c2e-8d60-4f1b-876d-f927d85bdbdd req-651c03d3-bf34-45ab-8ce2-31a570ceb27e service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.compute.manager [req-055f3c2e-8d60-4f1b-876d-f927d85bdbdd req-651c03d3-bf34-45ab-8ce2-31a570ceb27e service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] No waiting events found dispatching network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:15 user nova-compute[74421]: WARNING nova.compute.manager [req-055f3c2e-8d60-4f1b-876d-f927d85bdbdd req-651c03d3-bf34-45ab-8ce2-31a570ceb27e service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received unexpected event network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 for instance with vm_state building and task_state spawning.
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:38:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Instance spawned successfully.
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:38:15 user nova-compute[74421]: INFO nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Took 5.82 seconds to spawn the instance on the hypervisor.
Oct 23 15:38:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:38:15 user nova-compute[74421]: INFO nova.compute.manager [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Took 6.73 seconds to build instance.
Oct 23 15:38:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d3444aef-ff23-432f-809f-164986b971fb tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.827s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 797f85e1-87ce-4295-8e14-19fd0919f2a0 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 83da5c9e-eac9-4f74-9c0c-b003b475415a {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 0d259e70-884d-49c7-9a98-d318ecb01841 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 71f11170-4d47-419e-a067-dbc82352a8b9 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "0d259e70-884d-49c7-9a98-d318ecb01841" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "0d259e70-884d-49c7-9a98-d318ecb01841" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'flavor' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8089ce2f-6a30-4e19-802c-73197ec6b9ab tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.093s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.860s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRvrzZUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:29 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:29 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:29 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c787db0-afb3-4260-ba8f-bd9b3123fecf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:38:29 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[965543cf-3295-4779-89a8-6d5eaa09b725]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b] added
Oct 23 15:38:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a629c021-3f4c-4ce9-92d8-156c09071013]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8260b2-f680-4e6c-adf5-c230dc315f71]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRvrzZUa {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRvrzZUa" returned: 0 in 0.034s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cfdbc1-ac40-477a-838e-3b900b4c7a1d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRvrzZUa'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d147b35-f03e-4dd4-84cf-c7c9d08b6927]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258af30-6464-4181-b7bb-164f18fa1015]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81f6a3-a976-4424-b4ae-dc0afc856cfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260]
Oct 23 15:38:29 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260] successful.
Oct 23 15:38:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ecc485-b6d7-4a72-83d0-f8eb19085744]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27576766-568c-4273-8b64-cc46c31c3dc4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:29 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[23553c09-e27c-44b1-9bc0-06dc9dba184d]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:38:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRvrzZUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:38:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23165346562303632', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165346562303632', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:38:30 user nova-compute[74421]: DEBUG nova.objects.instance [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'flavor' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:38:30 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:38:30 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:38:30 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:38:30 user nova-compute[74421]:   <serial>d001a819-a587-430a-a818-3b996cb6d03b</serial>
Oct 23 15:38:30 user nova-compute[74421]: </disk>
Oct 23 15:38:30 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No VIF found with MAC fa:16:3e:61:b6:db, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bc8f30f1-23ce-489f-9dfa-ccdcbf70f418 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.104s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.051s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'flavor' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:33 user nova-compute[74421]: INFO nova.compute.manager [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Attaching volume 44cc0772-bba2-4065-bf30-257fee16082e to /dev/vdb
Oct 23 15:38:33 user nova-compute[74421]: DEBUG os_brick.utils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[73db78d5-3d41-42f5-b196-869007d0d440]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[286f9fc4-af00-429d-aa7d-974b1fda6dee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d00668-e665-4b57-8c69-b3cc97b56255]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac6280-5026-4bfe-8670-20c4be77ea70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:38:33 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:38:33 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e60ae2-4ed4-451e-aaea-149a5b8eae72]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG os_brick.utils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:33 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating existing volume attachment record: f65cec2a-6f3a-4427-a9ce-9bf537e68c32 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'flavor' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:35 user nova-compute[74421]: INFO nova.compute.manager [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attaching volume 8d13b847-6b4f-4c63-816a-53b86c27be79 to /dev/vdc
Oct 23 15:38:35 user nova-compute[74421]: DEBUG os_brick.utils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0c71fe-2557-4449-a446-f67df9ca79f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bfe350-729d-4c4e-a790-b0b051e7232b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[816527b5-9285-4b23-9960-e2dbe62ef654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb553fda-3975-4e4e-a7fc-37c91bb282cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:38:35 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:38:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2a1e3-1d39-4e0a-b4d0-9ef2d4698938]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG os_brick.utils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:35 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updating existing volume attachment record: 7b358278-078d-490d-b1e0-f36059d86eb2 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:38:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:42 user nova-compute[74421]: INFO nova.compute.manager [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Terminating instance
Oct 23 15:38:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-63e5b0d9-97aa-4704-9eae-e5b0e0b52122 req-0e58d338-4411-494d-9e32-4db31efb0d94 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-unplugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-63e5b0d9-97aa-4704-9eae-e5b0e0b52122 req-0e58d338-4411-494d-9e32-4db31efb0d94 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-63e5b0d9-97aa-4704-9eae-e5b0e0b52122 req-0e58d338-4411-494d-9e32-4db31efb0d94 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-63e5b0d9-97aa-4704-9eae-e5b0e0b52122 req-0e58d338-4411-494d-9e32-4db31efb0d94 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-63e5b0d9-97aa-4704-9eae-e5b0e0b52122 req-0e58d338-4411-494d-9e32-4db31efb0d94 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-unplugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-63e5b0d9-97aa-4704-9eae-e5b0e0b52122 req-0e58d338-4411-494d-9e32-4db31efb0d94 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-unplugged-3275c793-6085-4756-962c-aebd39dc408a for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Instance destroyed successfully.
Oct 23 15:38:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'resources' on Instance uuid a43d4143-17b5-4a95-8e03-3c47568ba3e2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-571678447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-571678447',id=28,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeDIxepctcSrFTcbLK/ccp3FKUQ7tG5yVqw4T3D9JpBAK4oJeTw5kVYD2cdrIdKMrjqMaMOt+5F1VSgudkgXPH5is6aIjzJnOJfumdleq7j7KKqSkfP14pZg+YGcSPNkw==',key_name='tempest-keypair-91007934',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:36:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-yqousym9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:36:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=a43d4143-17b5-4a95-8e03-3c47568ba3e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "3275c793-6085-4756-962c-aebd39dc408a", "address": "fa:16:3e:5e:18:9c", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3275c793-60", "ovs_interfaceid": "3275c793-6085-4756-962c-aebd39dc408a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG os_vif [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3275c793-60, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=521cb804-fa96-41c1-b21c-b5465a47dcc2) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:43 user nova-compute[74421]: INFO os_vif [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=3275c793-6085-4756-962c-aebd39dc408a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3275c793-60')
Oct 23 15:38:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Deleting instance files /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2_del
Oct 23 15:38:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Deletion of /opt/stack/data/nova/instances/a43d4143-17b5-4a95-8e03-3c47568ba3e2_del complete
Oct 23 15:38:43 user nova-compute[74421]: INFO nova.compute.manager [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 15:38:43 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:38:43 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:44 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Took 0.67 seconds to deallocate network for instance.
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:44 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Deleted allocations for instance a43d4143-17b5-4a95-8e03-3c47568ba3e2
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cca3efc3-14d0-4ff7-8b4e-6a7d2b7110aa tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] Acquiring lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] Lock "a43d4143-17b5-4a95-8e03-3c47568ba3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] No waiting events found dispatching network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:44 user nova-compute[74421]: WARNING nova.compute.manager [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received unexpected event network-vif-plugged-3275c793-6085-4756-962c-aebd39dc408a for instance with vm_state deleted and task_state None.
Oct 23 15:38:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd6efee2-b7a1-460c-9e46-cf9d50529ed8 req-e4733f3d-396d-4476-a8ca-0b28a029c489 service nova] [instance: a43d4143-17b5-4a95-8e03-3c47568ba3e2] Received event network-vif-deleted-3275c793-6085-4756-962c-aebd39dc408a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:38:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:38:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:38:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [{"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-7767aaf1-9958-446c-ba3f-708fddb78750" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:38:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.363s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKYncWis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:51 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:51 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:51 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55f0bb8-2769-4849-8c3f-ff79204a06cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:38:51 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7632a-2375-498d-85ca-c4d1cd8aecab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e] added
Oct 23 15:38:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa362908-69be-4bc2-8f06-5a4a95bf920f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd001442-e613-4581-8b0a-07c415505331]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKYncWis {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKYncWis" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf28ee3-32bb-4e7b-95e3-ec271a71e5c5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKYncWis'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9334c677-c371-48d3-8a8d-3a9ff64b4a95]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b2e5bc-6b3c-46cf-95ad-07755baf600e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a555408-2550-4ef2-9b9e-b13f12be889f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260]
Oct 23 15:38:51 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260] successful.
Oct 23 15:38:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedccde5-2fb0-423a-9000-1103f938359b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bbc64c-e43d-4a10-8f61-34a82e82ac20]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:38:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:51 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:38:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6e76a2-a1ac-4fb0-b13e-c99d9328f632]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKYncWis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:38:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:38:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=24.856647491455078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 0d259e70-884d-49c7-9a98-d318ecb01841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 71f11170-4d47-419e-a067-dbc82352a8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a741ac42-e881-435c-b7e7-9ea98a9ff132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23162363336633631', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162363336633631', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'flavor' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:38:52 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:38:52 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:38:52 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:38:52 user nova-compute[74421]:   <serial>44cc0772-bba2-4065-bf30-257fee16082e</serial>
Oct 23 15:38:52 user nova-compute[74421]: </disk>
Oct 23 15:38:52 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.736s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No VIF found with MAC fa:16:3e:03:60:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:38:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a642cec3-71a0-4261-8748-ad8f619d65d0 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.431s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:54 user nova-compute[74421]: INFO nova.compute.manager [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Rescuing
Oct 23 15:38:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-cce35eaa-148f-4f82-b1e1-e251ea21d712 req-aa12d9d9-d5b8-4ac5-8a51-c767099d0756 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cce35eaa-148f-4f82-b1e1-e251ea21d712 req-aa12d9d9-d5b8-4ac5-8a51-c767099d0756 service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cce35eaa-148f-4f82-b1e1-e251ea21d712 req-aa12d9d9-d5b8-4ac5-8a51-c767099d0756 service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-cce35eaa-148f-4f82-b1e1-e251ea21d712 req-aa12d9d9-d5b8-4ac5-8a51-c767099d0756 service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-cce35eaa-148f-4f82-b1e1-e251ea21d712 req-aa12d9d9-d5b8-4ac5-8a51-c767099d0756 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:54 user nova-compute[74421]: WARNING nova.compute.manager [req-cce35eaa-148f-4f82-b1e1-e251ea21d712 req-aa12d9d9-d5b8-4ac5-8a51-c767099d0756 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state active and task_state rescuing.
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:38:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance destroyed successfully.
Oct 23 15:38:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Attempting a stable device rescue
Oct 23 15:38:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74421) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:38:55 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Creating image(s)
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:55 user nova-compute[74421]: INFO nova.compute.manager [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Terminating instance
Oct 23 15:38:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "3a51260008896d43b79cb2a99b61a99c5df5122c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "3a51260008896d43b79cb2a99b61a99c5df5122c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Instance destroyed successfully.
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.objects.instance [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'resources' on Instance uuid d1ad1db4-d19c-42d6-a7af-3296b6c7c461 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1964539500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1964539500',id=30,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-4z2qr04e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:37:09Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=d1ad1db4-d19c-42d6-a7af-3296b6c7c461,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "06515616-6772-42e4-be50-62701e4b4fcb", "address": "fa:16:3e:a9:55:c5", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06515616-67", "ovs_interfaceid": "06515616-6772-42e4-be50-62701e4b4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_vif [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06515616-67, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c177bde0-03a2-488d-a97f-db6a31ce7e72) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:56 user nova-compute[74421]: INFO os_vif [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=06515616-6772-42e4-be50-62701e4b4fcb,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06515616-67')
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftuNHOrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:56 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee636f1-c44f-4e79-9bdf-297bf91a68db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:38:56 user nova-compute[74421]: No targets found.
Oct 23 15:38:56 user nova-compute[74421]: iSNS:
Oct 23 15:38:56 user nova-compute[74421]: No targets found.
Oct 23 15:38:56 user nova-compute[74421]: STATIC:
Oct 23 15:38:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:38:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067
Oct 23 15:38:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:38:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b
Oct 23 15:38:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:38:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:38:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:38:56 user nova-compute[74421]: FIRMWARE:
Oct 23 15:38:56 user nova-compute[74421]: No targets found.
Oct 23 15:38:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:38:56 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:38:56 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a352168-3ef6-4e14-9ba5-2416f0a2f26e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.virt.images [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] 78179645-2fb0-4d4e-93c5-2a0a154e0920 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.part /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04d36a-5f2a-43e3-943d-e0946d3dd97b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:38:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:56 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:38:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2480214af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99fbde9-75c2-45a3-bfd5-5a379c7ddbf4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed8d769-ffc5-45c5-8bfa-ef051aecca97]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08516d-c29a-4e04-8792-f862e4c1eb1d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcecf8b-300a-4671-bf78-ba8bfc9907db]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d905e-70a5-4286-a8a4-fdfeca0dc7c4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:56 user nova-compute[74421]: WARNING nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state active and task_state rescuing.
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-unplugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Acquiring lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] No waiting events found dispatching network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:56 user nova-compute[74421]: WARNING nova.compute.manager [req-4d306479-530f-4e43-9569-a6f02b88e174 req-6b560e5e-382e-4bbf-9e21-e8eabbb3a1fd service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received unexpected event network-vif-plugged-06515616-6772-42e4-be50-62701e4b4fcb for instance with vm_state active and task_state deleting.
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db94db-950d-4136-8b70-8a13abb39431]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260]
Oct 23 15:38:57 user nova-compute[74421]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067, portal: 172.16.0.220,3260] successful.
Oct 23 15:38:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec12c5b-6363-4442-8b4e-f949e29d8067 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[52091137-4c29-4cf7-8d50-1edb94cfe53e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== disconnect_volume: return (457ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:38:57 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Deleting instance files /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461_del
Oct 23 15:38:57 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Deletion of /opt/stack/data/nova/instances/d1ad1db4-d19c-42d6-a7af-3296b6c7c461_del complete
Oct 23 15:38:57 user nova-compute[74421]: INFO nova.compute.manager [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Took 1.84 seconds to destroy the instance on the hypervisor.
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.part /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.converted" returned: 0 in 0.639s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "3a51260008896d43b79cb2a99b61a99c5df5122c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.064s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "3a51260008896d43b79cb2a99b61a99c5df5122c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "3a51260008896d43b79cb2a99b61a99c5df5122c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c,backing_fmt=raw /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-9664f94d-bd75-4677-90be-2add746e64fd req-f0b4fa9e-f537-481d-abec-c4a8164c5583 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Received event network-vif-deleted-06515616-6772-42e4-be50-62701e4b4fcb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:57 user nova-compute[74421]: INFO nova.compute.manager [req-9664f94d-bd75-4677-90be-2add746e64fd req-f0b4fa9e-f537-481d-abec-c4a8164c5583 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Neutron deleted interface 06515616-6772-42e4-be50-62701e4b4fcb; detaching it from the instance and deleting it from the info cache
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.network.neutron [req-9664f94d-bd75-4677-90be-2add746e64fd req-f0b4fa9e-f537-481d-abec-c4a8164c5583 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c,backing_fmt=raw /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue" returned: 0 in 0.064s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "3a51260008896d43b79cb2a99b61a99c5df5122c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'migration_context' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:57 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Took 0.49 seconds to deallocate network for instance.
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Object Instance<8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Start _get_guest_xml network_info=[{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "vif_mac": "fa:16:3e:03:60:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '78179645-2fb0-4d4e-93c5-2a0a154e0920', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'f65cec2a-6f3a-4427-a9ce-9bf537e68c32', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKYncWis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3', 'attached_at': '', 'detached_at': '', 'volume_id': '44cc0772-bba2-4065-bf30-257fee16082e', 'serial': '44cc0772-bba2-4065-bf30-257fee16082e'}, 'boot_index': None, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'resources' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-9664f94d-bd75-4677-90be-2add746e64fd req-f0b4fa9e-f537-481d-abec-c4a8164c5583 service nova] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Detach interface failed, port_id=06515616-6772-42e4-be50-62701e4b4fcb, reason: Instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Object Instance<8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'numa_topology' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Object Instance<8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:38:57 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:38:57 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.objects.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Object Instance<8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKYncWis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:38:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:38:57 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f4e0c-bfb6-4819-8732-80ead3ca718f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dKYncWis\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 15:38:57 user nova-compute[74421]: node.name = iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:38:57 user nova-compute[74421]: node.tpgt = -1
Oct 23 15:38:57 user nova-compute[74421]: node.startup = automatic
Oct 23 15:38:57 user nova-compute[74421]: node.leading_login = No
Oct 23 15:38:57 user nova-compute[74421]: iface.iscsi_ifacename = default
Oct 23 15:38:57 user nova-compute[74421]: iface.net_ifacename = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.ipaddress = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.prefix_len = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.hwaddress = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.transport_name = tcp
Oct 23 15:38:57 user nova-compute[74421]: iface.initiatorname = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.vlan_id = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.vlan_priority = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.vlan_state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.iface_num = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.mtu = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.port = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.bootproto = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.subnet_mask = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.gateway = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_alt_client_id = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_dns = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_learn_iqn = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_vendor_id_state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_vendor_id = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.dhcp_slp_da = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.fragmentation = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.gratuitous_arp = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.incoming_forwarding = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.tos_state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.tos = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.ttl = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.delayed_ack = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.tcp_nagle = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.tcp_wsf_state = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.tcp_wsf = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.tcp_timer_scale = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.tcp_timestamp = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.redirect = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.def_task_mgmt_timeout = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.header_digest = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.data_digest = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.immediate_data = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.initial_r2t = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.data_seq_inorder = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.data_pdu_inorder = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.erl = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.max_receive_data_len = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.first_burst_len = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.max_outstanding_r2t = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.max_burst_len = 0
Oct 23 15:38:57 user nova-compute[74421]: iface.chap_auth = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.bidi_chap = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.strict_login_compliance = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.discovery_auth = <empty>
Oct 23 15:38:57 user nova-compute[74421]: iface.discovery_logout = <empty>
Oct 23 15:38:57 user nova-compute[74421]: node.discovery_address = <empty>
Oct 23 15:38:57 user nova-compute[74421]: node.discovery_port = 0
Oct 23 15:38:57 user nova-compute[74421]: node.discovery_type = static
Oct 23 15:38:57 user nova-compute[74421]: node.session.initial_cmdsn = 0
Oct 23 15:38:57 user nova-compute[74421]: node.session.initial_login_retry_max = 8
Oct 23 15:38:57 user nova-compute[74421]: node.session.xmit_thread_priority = -20
Oct 23 15:38:57 user nova-compute[74421]: node.session.cmds_max = 128
Oct 23 15:38:57 user nova-compute[74421]: node.session.queue_depth = 32
Oct 23 15:38:57 user nova-compute[74421]: node.session.nr_sessions = 1
Oct 23 15:38:57 user nova-compute[74421]: node.session.auth.authmethod = CHAP
Oct 23 15:38:57 user nova-compute[74421]: node.session.auth.username = dKYncWis
Oct 23 15:38:57 user nova-compute[74421]: node.session.auth.password = ***
Oct 23 15:38:57 user nova-compute[74421]: node.session.auth.username_in = <empty>
Oct 23 15:38:57 user nova-compute[74421]: node.session.auth.password_in = <empty>
Oct 23 15:38:57 user nova-compute[74421]: node.session.auth.chap_algs = MD5
Oct 23 15:38:57 user nova-compute[74421]: node.session.timeo.replacement_timeout = 120
Oct 23 15:38:57 user nova-compute[74421]: node.session.err_timeo.abort_timeout = 15
Oct 23 15:38:57 user nova-compute[74421]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 15:38:57 user nova-compute[74421]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 15:38:57 user nova-compute[74421]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.FastAbort = Yes
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.InitialR2T = No
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.ImmediateData = Yes
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.MaxConnections = 1
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 15:38:57 user nova-compute[74421]: node.session.iscsi.ERL = 0
Oct 23 15:38:57 user nova-compute[74421]: node.session.scan = manual
Oct 23 15:38:57 user nova-compute[74421]: node.session.reopen_max = 0
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].address = 172.16.0.220
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].port = 3260
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].startup = manual
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].tcp.window_size = 524288
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].tcp.type_of_service = 0
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].timeo.logout_timeout = 15
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].timeo.login_timeout = 15
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].timeo.auth_timeout = 45
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].iscsi.DataDigest = None
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].iscsi.IFMarker = No
Oct 23 15:38:57 user nova-compute[74421]: node.conn[0].iscsi.OFMarker = No
Oct 23 15:38:57 user nova-compute[74421]: # END RECORD
Oct 23 15:38:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b50f8fa-861f-44aa-8be0-0c4342289cb4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00d0791-35a6-4d4a-b1af-6693a5c9edd5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKYncWis {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKYncWis" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd09f21-651f-4ed2-ac8c-717ecf0f73cb]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKYncWis'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d41ec3-912a-460f-a813-33f96c8541f9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a8656-4b49-4da4-b77e-89b5dcb1f028]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:58 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:58 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:58 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:38:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:38:58 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:38:58 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:38:58 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:38:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cd3282-f57b-4de1-9fdb-fe799e2244a8]: (4, ('0 0 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKYncWis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23162363336633631', 'path': '/dev/sdf'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162363336633631', 'path': '/dev/sdf'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-421215235',display_name='tempest-ServerStableDeviceRescueTest-server-421215235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-421215235',id=32,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBvo0kVlIhhyl67IvxCbw2l4gBzHopt6ssxdLzHTEiG+m4TghLNIFCoYGZEPBE2ROJ4/vgCRLw5ObBwv1WqcT2PAO0jtPBiAyYOJIvlFS999aFAy4jfuCRX5i50Vi9tqg==',key_name='tempest-keypair-1702398332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:34:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c0d0b7398cb46eb8679e805d97f885d',ramdisk_id='',reservation_id='r-he732kxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1906331641',owner_user_name='tempest-ServerStableDeviceRescueTest-1906331641-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:36:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dd14495e7f4cf8b8749576587dcd0f',uuid=8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "vif_mac": "fa:16:3e:03:60:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converting VIF {"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "vif_mac": "fa:16:3e:03:60:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.objects.base [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Object Instance<8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:38:58 user nova-compute[74421]:   <uuid>8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3</uuid>
Oct 23 15:38:58 user nova-compute[74421]:   <name>instance-00000020</name>
Oct 23 15:38:58 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:38:58 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:38:58 user nova-compute[74421]:   <metadata>
Oct 23 15:38:58 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:38:58 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:38:58 user nova-compute[74421]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-421215235</nova:name>
Oct 23 15:38:58 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:38:57</nova:creationTime>
Oct 23 15:38:58 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:38:58 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:38:58 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:38:58 user nova-compute[74421]:       <nova:owner>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:user uuid="48dd14495e7f4cf8b8749576587dcd0f">tempest-ServerStableDeviceRescueTest-1906331641-project-member</nova:user>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:project uuid="3c0d0b7398cb46eb8679e805d97f885d">tempest-ServerStableDeviceRescueTest-1906331641</nova:project>
Oct 23 15:38:58 user nova-compute[74421]:       </nova:owner>
Oct 23 15:38:58 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:38:58 user nova-compute[74421]:       <nova:ports>
Oct 23 15:38:58 user nova-compute[74421]:         <nova:port uuid="3732d23a-cecb-4ede-b572-d105a2c3dda3">
Oct 23 15:38:58 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:38:58 user nova-compute[74421]:         </nova:port>
Oct 23 15:38:58 user nova-compute[74421]:       </nova:ports>
Oct 23 15:38:58 user nova-compute[74421]:     </nova:instance>
Oct 23 15:38:58 user nova-compute[74421]:   </metadata>
Oct 23 15:38:58 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:38:58 user nova-compute[74421]:     <system>
Oct 23 15:38:58 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:38:58 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:38:58 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:38:58 user nova-compute[74421]:       <entry name="serial">8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3</entry>
Oct 23 15:38:58 user nova-compute[74421]:       <entry name="uuid">8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3</entry>
Oct 23 15:38:58 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:38:58 user nova-compute[74421]:     </system>
Oct 23 15:38:58 user nova-compute[74421]:   </sysinfo>
Oct 23 15:38:58 user nova-compute[74421]:   <os>
Oct 23 15:38:58 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:38:58 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:38:58 user nova-compute[74421]:   </os>
Oct 23 15:38:58 user nova-compute[74421]:   <features>
Oct 23 15:38:58 user nova-compute[74421]:     <acpi/>
Oct 23 15:38:58 user nova-compute[74421]:     <apic/>
Oct 23 15:38:58 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:38:58 user nova-compute[74421]:   </features>
Oct 23 15:38:58 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:38:58 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:38:58 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:38:58 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:38:58 user nova-compute[74421]:   </clock>
Oct 23 15:38:58 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:38:58 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:38:58 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:38:58 user nova-compute[74421]:   </cpu>
Oct 23 15:38:58 user nova-compute[74421]:   <devices>
Oct 23 15:38:58 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:38:58 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:38:58 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk"/>
Oct 23 15:38:58 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:38:58 user nova-compute[74421]:     </disk>
Oct 23 15:38:58 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:38:58 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:38:58 user nova-compute[74421]:       <source dev="/dev/sdf"/>
Oct 23 15:38:58 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:38:58 user nova-compute[74421]:       <serial>44cc0772-bba2-4065-bf30-257fee16082e</serial>
Oct 23 15:38:58 user nova-compute[74421]:     </disk>
Oct 23 15:38:58 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:38:58 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:38:58 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue"/>
Oct 23 15:38:58 user nova-compute[74421]:       <target dev="vdc" bus="virtio"/>
Oct 23 15:38:58 user nova-compute[74421]:       <boot order="1"/>
Oct 23 15:38:58 user nova-compute[74421]:     </disk>
Oct 23 15:38:58 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:38:58 user nova-compute[74421]:       <mac address="fa:16:3e:03:60:32"/>
Oct 23 15:38:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:38:58 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:38:58 user nova-compute[74421]:       <target dev="tap3732d23a-ce"/>
Oct 23 15:38:58 user nova-compute[74421]:     </interface>
Oct 23 15:38:58 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:38:58 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/console.log" append="off"/>
Oct 23 15:38:58 user nova-compute[74421]:     </serial>
Oct 23 15:38:58 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:38:58 user nova-compute[74421]:     <video>
Oct 23 15:38:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:38:58 user nova-compute[74421]:     </video>
Oct 23 15:38:58 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:38:58 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:38:58 user nova-compute[74421]:     </rng>
Oct 23 15:38:58 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:38:58 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:38:58 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:38:58 user nova-compute[74421]:     </memballoon>
Oct 23 15:38:58 user nova-compute[74421]:   </devices>
Oct 23 15:38:58 user nova-compute[74421]: </domain>
Oct 23 15:38:58 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:38:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance destroyed successfully.
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] No VIF found with MAC fa:16:3e:03:60:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:38:58 user nova-compute[74421]: INFO nova.compute.manager [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: d1ad1db4-d19c-42d6-a7af-3296b6c7c461] Took 0.82 seconds to detach 1 volumes for instance.
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:59 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Deleted allocations for instance d1ad1db4-d19c-42d6-a7af-3296b6c7c461
Oct 23 15:38:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cbbd98ee-11cf-4e9b-a269-8badd3ca7a1f tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "d1ad1db4-d19c-42d6-a7af-3296b6c7c461" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.777s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-d8eacfef-448f-45a6-b6a0-d0d3c2bc5be7 req-6c1dbeec-b08e-4c73-949c-5b3d24b7bf3e service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d8eacfef-448f-45a6-b6a0-d0d3c2bc5be7 req-6c1dbeec-b08e-4c73-949c-5b3d24b7bf3e service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d8eacfef-448f-45a6-b6a0-d0d3c2bc5be7 req-6c1dbeec-b08e-4c73-949c-5b3d24b7bf3e service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d8eacfef-448f-45a6-b6a0-d0d3c2bc5be7 req-6c1dbeec-b08e-4c73-949c-5b3d24b7bf3e service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:38:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-d8eacfef-448f-45a6-b6a0-d0d3c2bc5be7 req-6c1dbeec-b08e-4c73-949c-5b3d24b7bf3e service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:38:59 user nova-compute[74421]: WARNING nova.compute.manager [req-d8eacfef-448f-45a6-b6a0-d0d3c2bc5be7 req-6c1dbeec-b08e-4c73-949c-5b3d24b7bf3e service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state active and task_state rescuing.
Oct 23 15:39:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-d534823d-630e-4eba-b11b-f125ca88e1fe req-8387f51b-14e3-422a-9e78-2c26f9ef86aa service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d534823d-630e-4eba-b11b-f125ca88e1fe req-8387f51b-14e3-422a-9e78-2c26f9ef86aa service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d534823d-630e-4eba-b11b-f125ca88e1fe req-8387f51b-14e3-422a-9e78-2c26f9ef86aa service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d534823d-630e-4eba-b11b-f125ca88e1fe req-8387f51b-14e3-422a-9e78-2c26f9ef86aa service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-d534823d-630e-4eba-b11b-f125ca88e1fe req-8387f51b-14e3-422a-9e78-2c26f9ef86aa service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:01 user nova-compute[74421]: WARNING nova.compute.manager [req-d534823d-630e-4eba-b11b-f125ca88e1fe req-8387f51b-14e3-422a-9e78-2c26f9ef86aa service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state active and task_state rescuing.
Oct 23 15:39:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e675c602-6334-4d5e-a99d-276c7b03df37 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:39:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHdIrzoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:39:06 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:06 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:06 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfc9e4f-12f4-4734-91bc-39bb0c99bd2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:39:06 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d13a01-925f-4a5b-a7d4-d1558ecace02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79] added
Oct 23 15:39:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f4b72-316d-4839-833d-35826e4cd171]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c2822-043d-4f91-84c2-5f60edddd7ee]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHdIrzoJ {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHdIrzoJ" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264f6bd-d449-4dc3-8d78-7cf13e3605d6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHdIrzoJ'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef1d5f-1a5a-480e-939b-38c79889c719]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ca5012-76d0-4bda-9609-4a564b23fa99]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[15408cf5-3e51-4f18-bb48-dab683310dcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260]
Oct 23 15:39:06 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260] successful.
Oct 23 15:39:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b9bb4-eaf0-450e-84fc-89a1fe6769b9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba93588-ff08-4aa1-b418-d8cf14122842]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:06 user nova-compute[74421]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 (non-flash)
Oct 23 15:39:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3788ddd-83f9-482f-99a4-c4cfb5ba7ed0]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:39:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHdIrzoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:39:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:39:07 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26331336536396130', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:39:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331336536396130', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:39:07 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'flavor' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:39:07 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:39:07 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:39:07 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:39:07 user nova-compute[74421]:   <serial>8d13b847-6b4f-4c63-816a-53b86c27be79</serial>
Oct 23 15:39:07 user nova-compute[74421]: </disk>
Oct 23 15:39:07 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:39:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:08 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] No VIF found with MAC fa:16:3e:61:b6:db, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:39:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c5190ad6-a489-4369-9464-2e1382b122b4 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.887s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:09 user nova-compute[74421]: INFO nova.compute.manager [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Detaching volume 8d13b847-6b4f-4c63-816a-53b86c27be79
Oct 23 15:39:09 user nova-compute[74421]: INFO nova.virt.block_device [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attempting to driver detach volume 8d13b847-6b4f-4c63-816a-53b86c27be79 from mountpoint /dev/vdc
Oct 23 15:39:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Attempting to detach device vdc from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:39:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:39:09 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:39:09 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:39:09 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:39:09 user nova-compute[74421]:   <serial>8d13b847-6b4f-4c63-816a-53b86c27be79</serial>
Oct 23 15:39:09 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 15:39:09 user nova-compute[74421]: </disk>
Oct 23 15:39:09 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:39:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Successfully detached device vdc from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the persistent domain config.
Oct 23 15:39:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:39:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:39:09 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:39:09 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:39:09 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:39:09 user nova-compute[74421]:   <serial>8d13b847-6b4f-4c63-816a-53b86c27be79</serial>
Oct 23 15:39:09 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 15:39:09 user nova-compute[74421]: </disk>
Oct 23 15:39:09 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:39:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:39:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:39:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing instance network info cache due to event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG nova.network.neutron [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'flavor' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updated VIF entry in instance network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:20 user nova-compute[74421]: INFO nova.compute.manager [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Attaching volume 74c84120-4b83-4da3-a9cd-4b48057dc051 to /dev/vdb
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52064fe3-6adc-4e33-805a-fc319c156c77 req-b506ef00-948e-420d-b18b-405be886a4ea service nova] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b895e4-abbf-419a-8903-e76364d2ce7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e76797-a0cf-4f08-abfc-0b7cd4025ecd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca8359-6637-406a-a5fe-abe947812862]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424835f-3d0b-4ae5-8c66-7502f2b5fd73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:39:20 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:39:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b9656-1a24-48ba-a964-2ec2bd4af75d]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG os_brick.utils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating existing volume attachment record: f97c9989-12d6-4973-a83b-765405959bd1 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:39:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 is timed out.
Oct 23 15:39:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Successfully detached device vdc from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the live domain config.
Oct 23 15:39:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHdIrzoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:39:29 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e0ba0a-0f95-4aaa-a5a2-dfe90fadda1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:39:29 user nova-compute[74421]: No targets found.
Oct 23 15:39:29 user nova-compute[74421]: iSNS:
Oct 23 15:39:29 user nova-compute[74421]: No targets found.
Oct 23 15:39:29 user nova-compute[74421]: STATIC:
Oct 23 15:39:29 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:39:29 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:39:29 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:39:29 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79
Oct 23 15:39:29 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:39:29 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:39:29 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:39:29 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:39:29 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:39:29 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b
Oct 23 15:39:29 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:39:29 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:39:29 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:39:29 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:39:29 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:39:29 user nova-compute[74421]: FIRMWARE:
Oct 23 15:39:29 user nova-compute[74421]: No targets found.
Oct 23 15:39:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:39:29 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:39:29 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2149d3d8-5a7a-430c-89cf-e910e389b5b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e347b-cb7b-41b1-99cb-905f9a105f9c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 (non-flash)
Oct 23 15:39:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:29 user nova-compute[74421]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 (non-flash)
Oct 23 15:39:29 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478204700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db03044-41dc-48de-a0a5-a9a7662e1012]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1221362-267e-42cd-9629-107217c59277]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d342f5f-208d-4874-9424-938db31fbeb7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9016e0a-70d1-48d1-be43-dd9cfbb083e6]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:39:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0deb7e-d37d-48e2-a335-faafc70b298b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ddef68-b38f-4164-ac83-b3957766b931]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260]
Oct 23 15:39:30 user nova-compute[74421]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79, portal: 172.16.0.220,3260] successful.
Oct 23 15:39:30 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d13b847-6b4f-4c63-816a-53b86c27be79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f80357-4069-4313-bd13-61640982d28e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] <== disconnect_volume: return (374ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:30 user nova-compute[74421]: DEBUG nova.objects.instance [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'flavor' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-52f355e3-18c7-475a-bdab-5e66ec0b4e99 tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:33 user nova-compute[74421]: INFO nova.compute.manager [None req-f6ccd7e1-0b85-4472-8261-df317299816c tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Get console output
Oct 23 15:39:33 user nova-compute[74421]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 23 15:39:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:36 user nova-compute[74421]: INFO nova.compute.manager [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Unshelving
Oct 23 15:39:36 user nova-compute[74421]: INFO nova.virt.block_device [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Booting with volume 1ce69ea3-e893-4552-b7d8-ab9396edad6c at /dev/vda
Oct 23 15:39:36 user nova-compute[74421]: DEBUG os_brick.utils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e2b0fb-f710-4937-9695-f923334186d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f97532b-fb69-42af-8a17-6cf7837ca70b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ff1e5-f9cc-4eeb-8823-70e262def8e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[468112d8-134b-4ce0-a6d7-d7a6ee0e7a46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:39:36 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2bca74-b112-4d6d-be62-3fa93167dcdb]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG os_brick.utils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating existing volume attachment record: 9c0fa038-28a4-4cd4-8daf-78aa741db41b {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:39:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:37 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:39:37 user nova-compute[74421]: INFO nova.compute.claims [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Claim successful on node user
Oct 23 15:39:37 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:39:37 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.947s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:39:38 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.policy [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd182e97e984debb9f71886b04df9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ef71af4864309b93505438743151f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:39:38 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Creating image(s)
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk 1073741824" returned: 0 in 0.052s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:39:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Successfully created port: 43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Cannot resize image /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Ensure instance console log exists: /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaKIbLrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:39:39 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:39 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:39 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f3e267-72b0-47f5-bd65-5e62ebc944a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:39:39 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca8cd2-2497-48e2-9620-f5682f19b176]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051] added
Oct 23 15:39:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a62eb5-a3f6-4fd3-99c4-a12166076cf3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51d63c-2327-49fb-8c57-995e2e28ec3e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaKIbLrm {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaKIbLrm" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42ee48a-a93a-4785-901d-79d896f4795b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaKIbLrm'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bdd540-fa68-4a8f-a81d-105c64451423]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8c0f00-c171-4167-b4dc-a72f12c45566]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ebbc22-f36b-4acd-97ab-e7499c153031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260]
Oct 23 15:39:39 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260] successful.
Oct 23 15:39:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[622cbac6-c7c4-45bd-a145-b618fb37cae2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8086102f-b354-4928-ace2-c6cfc3865515]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:39 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:39:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5122c409-81eb-4ff7-8cd3-ada2724de0cb]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Successfully updated port: 43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing instance network info cache due to event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:39 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance network_info: |[{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Start _get_guest_xml network_info=[{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:39:40 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:40 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-708899226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-708899226',id=37,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs2SJ3PWp8n1rZk+PqNlU/0TBjdJzfsVR5RXje4n8pWqSXgt2G70Zu90AZaj+CcqTUPLncgCtsTDJIvmstQIS9h3mCXuIIH5u65ApT9s1vhj70zZB2hFiY7VXD5pu3vhg==',key_name='tempest-keypair-1026354056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-icsh0y35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:39:40 user nova-compute[74421]:   <uuid>6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee</uuid>
Oct 23 15:39:40 user nova-compute[74421]:   <name>instance-00000025</name>
Oct 23 15:39:40 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:39:40 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:39:40 user nova-compute[74421]:   <metadata>
Oct 23 15:39:40 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:39:40 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:39:40 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-708899226</nova:name>
Oct 23 15:39:40 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:39:40</nova:creationTime>
Oct 23 15:39:40 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:39:40 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:39:40 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:39:40 user nova-compute[74421]:       <nova:owner>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:user uuid="6fd182e97e984debb9f71886b04df9bc">tempest-AttachVolumeShelveTestJSON-1510181551-project-member</nova:user>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:project uuid="314ef71af4864309b93505438743151f">tempest-AttachVolumeShelveTestJSON-1510181551</nova:project>
Oct 23 15:39:40 user nova-compute[74421]:       </nova:owner>
Oct 23 15:39:40 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:39:40 user nova-compute[74421]:       <nova:ports>
Oct 23 15:39:40 user nova-compute[74421]:         <nova:port uuid="43a0cdb2-cb72-44a7-b132-67a37512c70a">
Oct 23 15:39:40 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:39:40 user nova-compute[74421]:         </nova:port>
Oct 23 15:39:40 user nova-compute[74421]:       </nova:ports>
Oct 23 15:39:40 user nova-compute[74421]:     </nova:instance>
Oct 23 15:39:40 user nova-compute[74421]:   </metadata>
Oct 23 15:39:40 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:39:40 user nova-compute[74421]:     <system>
Oct 23 15:39:40 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:39:40 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:39:40 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:39:40 user nova-compute[74421]:       <entry name="serial">6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee</entry>
Oct 23 15:39:40 user nova-compute[74421]:       <entry name="uuid">6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee</entry>
Oct 23 15:39:40 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:39:40 user nova-compute[74421]:     </system>
Oct 23 15:39:40 user nova-compute[74421]:   </sysinfo>
Oct 23 15:39:40 user nova-compute[74421]:   <os>
Oct 23 15:39:40 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:39:40 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:39:40 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:39:40 user nova-compute[74421]:   </os>
Oct 23 15:39:40 user nova-compute[74421]:   <features>
Oct 23 15:39:40 user nova-compute[74421]:     <acpi/>
Oct 23 15:39:40 user nova-compute[74421]:     <apic/>
Oct 23 15:39:40 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:39:40 user nova-compute[74421]:   </features>
Oct 23 15:39:40 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:39:40 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:39:40 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:39:40 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:39:40 user nova-compute[74421]:   </clock>
Oct 23 15:39:40 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:39:40 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:39:40 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:39:40 user nova-compute[74421]:   </cpu>
Oct 23 15:39:40 user nova-compute[74421]:   <devices>
Oct 23 15:39:40 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:39:40 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:39:40 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk"/>
Oct 23 15:39:40 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:39:40 user nova-compute[74421]:     </disk>
Oct 23 15:39:40 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:39:40 user nova-compute[74421]:       <mac address="fa:16:3e:25:27:db"/>
Oct 23 15:39:40 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:39:40 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:39:40 user nova-compute[74421]:       <target dev="tap43a0cdb2-cb"/>
Oct 23 15:39:40 user nova-compute[74421]:     </interface>
Oct 23 15:39:40 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:39:40 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/console.log" append="off"/>
Oct 23 15:39:40 user nova-compute[74421]:     </serial>
Oct 23 15:39:40 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:39:40 user nova-compute[74421]:     <video>
Oct 23 15:39:40 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:39:40 user nova-compute[74421]:     </video>
Oct 23 15:39:40 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:39:40 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:39:40 user nova-compute[74421]:     </rng>
Oct 23 15:39:40 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:39:40 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:39:40 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:39:40 user nova-compute[74421]:     </memballoon>
Oct 23 15:39:40 user nova-compute[74421]:   </devices>
Oct 23 15:39:40 user nova-compute[74421]: </domain>
Oct 23 15:39:40 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-708899226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-708899226',id=37,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs2SJ3PWp8n1rZk+PqNlU/0TBjdJzfsVR5RXje4n8pWqSXgt2G70Zu90AZaj+CcqTUPLncgCtsTDJIvmstQIS9h3mCXuIIH5u65ApT9s1vhj70zZB2hFiY7VXD5pu3vhg==',key_name='tempest-keypair-1026354056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-icsh0y35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG os_vif [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0568514a-624e-5376-b2b8-617d26624a1e', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43a0cdb2-cb, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43a0cdb2-cb, col_values=(('qos', UUID('0ae3ffa0-4df4-475d-9461-dc1d0f25a5fd')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43a0cdb2-cb, col_values=(('external_ids', {'iface-id': '43a0cdb2-cb72-44a7-b132-67a37512c70a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:27:db', 'vm-uuid': '6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:40 user nova-compute[74421]: INFO os_vif [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb')
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No VIF found with MAC fa:16:3e:25:27:db, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaKIbLrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23338646533663731', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338646533663731', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.objects.instance [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'flavor' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:39:40 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:39:40 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:39:40 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:39:40 user nova-compute[74421]:   <serial>74c84120-4b83-4da3-a9cd-4b48057dc051</serial>
Oct 23 15:39:40 user nova-compute[74421]: </disk>
Oct 23 15:39:40 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updated VIF entry in instance network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7b81fdd6-f20a-47e4-8cab-f73696501460 req-a8025216-3789-4a04-89c6-bc1d2dfff3d6 service nova] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:3b:13:c0, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:39:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-f5b47732-785b-4fff-8654-338be9df0f33 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.405s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:42 user nova-compute[74421]: INFO nova.compute.manager [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Rescuing
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-5556822b-8624-43bd-afb9-fd49325d3e4e req-46f9eda4-4a90-476b-8b2b-7889c6d45417 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5556822b-8624-43bd-afb9-fd49325d3e4e req-46f9eda4-4a90-476b-8b2b-7889c6d45417 service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5556822b-8624-43bd-afb9-fd49325d3e4e req-46f9eda4-4a90-476b-8b2b-7889c6d45417 service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-5556822b-8624-43bd-afb9-fd49325d3e4e req-46f9eda4-4a90-476b-8b2b-7889c6d45417 service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-5556822b-8624-43bd-afb9-fd49325d3e4e req-46f9eda4-4a90-476b-8b2b-7889c6d45417 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:42 user nova-compute[74421]: WARNING nova.compute.manager [req-5556822b-8624-43bd-afb9-fd49325d3e4e req-46f9eda4-4a90-476b-8b2b-7889c6d45417 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state building and task_state spawning.
Oct 23 15:39:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-ed88996f-c71c-4f6d-a2ea-825e707360c0 req-98b0b926-efea-4abb-bce8-842fc2bc014a service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ed88996f-c71c-4f6d-a2ea-825e707360c0 req-98b0b926-efea-4abb-bce8-842fc2bc014a service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ed88996f-c71c-4f6d-a2ea-825e707360c0 req-98b0b926-efea-4abb-bce8-842fc2bc014a service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ed88996f-c71c-4f6d-a2ea-825e707360c0 req-98b0b926-efea-4abb-bce8-842fc2bc014a service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-ed88996f-c71c-4f6d-a2ea-825e707360c0 req-98b0b926-efea-4abb-bce8-842fc2bc014a service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:42 user nova-compute[74421]: WARNING nova.compute.manager [req-ed88996f-c71c-4f6d-a2ea-825e707360c0 req-98b0b926-efea-4abb-bce8-842fc2bc014a service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state active and task_state rescuing.
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance destroyed successfully.
Oct 23 15:39:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Attempting rescue
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74421) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance directory exists: not creating {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 15:39:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Creating image(s)
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'trusted_certs' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.171s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue" returned: 0 in 0.052s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'migration_context' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.base [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<146c13ae-a37f-406d-8dc6-13f0413efdae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Start _get_guest_xml network_info=[{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:3b:13:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'resources' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.base [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<146c13ae-a37f-406d-8dc6-13f0413efdae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'numa_topology' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.base [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<146c13ae-a37f-406d-8dc6-13f0413efdae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:39:43 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:43 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'vcpu_model' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.base [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<146c13ae-a37f-406d-8dc6-13f0413efdae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827231928',display_name='tempest-ServerRescueNegativeTestJSON-server-827231928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827231928',id=35,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8MdfSc5yON++t/AhakxtvmgxaNarlEI8Y5Bh9DMvYe9b/V9EZ2FEFc/eLDRPIcZ9oKQGvW6cYoDO1i6g421BLgXOwmCn0Ex+IXTAnYeDleENYS3/rdAUK1BU5vAFWJPQ==',key_name='tempest-keypair-1566777487',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:37:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-5hg9m7at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=146c13ae-a37f-406d-8dc6-13f0413efdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:3b:13:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "vif_mac": "fa:16:3e:3b:13:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'pci_devices' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.objects.base [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Object Instance<146c13ae-a37f-406d-8dc6-13f0413efdae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:39:43 user nova-compute[74421]:   <uuid>146c13ae-a37f-406d-8dc6-13f0413efdae</uuid>
Oct 23 15:39:43 user nova-compute[74421]:   <name>instance-00000023</name>
Oct 23 15:39:43 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:39:43 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:39:43 user nova-compute[74421]:   <metadata>
Oct 23 15:39:43 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:39:43 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:39:43 user nova-compute[74421]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-827231928</nova:name>
Oct 23 15:39:43 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:39:43</nova:creationTime>
Oct 23 15:39:43 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:39:43 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:39:43 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:39:43 user nova-compute[74421]:       <nova:owner>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:user uuid="6b5629aa90fa4b40b4886cb46dc21e65">tempest-ServerRescueNegativeTestJSON-1858635885-project-member</nova:user>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:project uuid="db8ed209b95549e8a0d77ead103b1c1a">tempest-ServerRescueNegativeTestJSON-1858635885</nova:project>
Oct 23 15:39:43 user nova-compute[74421]:       </nova:owner>
Oct 23 15:39:43 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:39:43 user nova-compute[74421]:       <nova:ports>
Oct 23 15:39:43 user nova-compute[74421]:         <nova:port uuid="01e85c82-ce95-4efc-b892-7195d64b52c8">
Oct 23 15:39:43 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:39:43 user nova-compute[74421]:         </nova:port>
Oct 23 15:39:43 user nova-compute[74421]:       </nova:ports>
Oct 23 15:39:43 user nova-compute[74421]:     </nova:instance>
Oct 23 15:39:43 user nova-compute[74421]:   </metadata>
Oct 23 15:39:43 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:39:43 user nova-compute[74421]:     <system>
Oct 23 15:39:43 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:39:43 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:39:43 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:39:43 user nova-compute[74421]:       <entry name="serial">146c13ae-a37f-406d-8dc6-13f0413efdae</entry>
Oct 23 15:39:43 user nova-compute[74421]:       <entry name="uuid">146c13ae-a37f-406d-8dc6-13f0413efdae</entry>
Oct 23 15:39:43 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:39:43 user nova-compute[74421]:     </system>
Oct 23 15:39:43 user nova-compute[74421]:   </sysinfo>
Oct 23 15:39:43 user nova-compute[74421]:   <os>
Oct 23 15:39:43 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:39:43 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:39:43 user nova-compute[74421]:   </os>
Oct 23 15:39:43 user nova-compute[74421]:   <features>
Oct 23 15:39:43 user nova-compute[74421]:     <acpi/>
Oct 23 15:39:43 user nova-compute[74421]:     <apic/>
Oct 23 15:39:43 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:39:43 user nova-compute[74421]:   </features>
Oct 23 15:39:43 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:39:43 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:39:43 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:39:43 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:39:43 user nova-compute[74421]:   </clock>
Oct 23 15:39:43 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:39:43 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:39:43 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:39:43 user nova-compute[74421]:   </cpu>
Oct 23 15:39:43 user nova-compute[74421]:   <devices>
Oct 23 15:39:43 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:39:43 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:39:43 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue"/>
Oct 23 15:39:43 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:39:43 user nova-compute[74421]:     </disk>
Oct 23 15:39:43 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:39:43 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:39:43 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk"/>
Oct 23 15:39:43 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:39:43 user nova-compute[74421]:     </disk>
Oct 23 15:39:43 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:39:43 user nova-compute[74421]:       <mac address="fa:16:3e:3b:13:c0"/>
Oct 23 15:39:43 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:39:43 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:39:43 user nova-compute[74421]:       <target dev="tap01e85c82-ce"/>
Oct 23 15:39:43 user nova-compute[74421]:     </interface>
Oct 23 15:39:43 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:39:43 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/console.log" append="off"/>
Oct 23 15:39:43 user nova-compute[74421]:     </serial>
Oct 23 15:39:43 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:39:43 user nova-compute[74421]:     <video>
Oct 23 15:39:43 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:39:43 user nova-compute[74421]:     </video>
Oct 23 15:39:43 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:39:43 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:39:43 user nova-compute[74421]:     </rng>
Oct 23 15:39:43 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:39:43 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:39:43 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:39:43 user nova-compute[74421]:     </memballoon>
Oct 23 15:39:43 user nova-compute[74421]:   </devices>
Oct 23 15:39:43 user nova-compute[74421]: </domain>
Oct 23 15:39:43 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:39:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance destroyed successfully.
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] No VIF found with MAC fa:16:3e:3b:13:c0, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:39:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance spawned successfully.
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-e5446f7e-eb0a-441f-8c0d-2e958c4ab3a1 req-73c97f02-2527-424a-a87b-d916c221f95f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e5446f7e-eb0a-441f-8c0d-2e958c4ab3a1 req-73c97f02-2527-424a-a87b-d916c221f95f service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e5446f7e-eb0a-441f-8c0d-2e958c4ab3a1 req-73c97f02-2527-424a-a87b-d916c221f95f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e5446f7e-eb0a-441f-8c0d-2e958c4ab3a1 req-73c97f02-2527-424a-a87b-d916c221f95f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-e5446f7e-eb0a-441f-8c0d-2e958c4ab3a1 req-73c97f02-2527-424a-a87b-d916c221f95f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:44 user nova-compute[74421]: WARNING nova.compute.manager [req-e5446f7e-eb0a-441f-8c0d-2e958c4ab3a1 req-73c97f02-2527-424a-a87b-d916c221f95f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state building and task_state spawning.
Oct 23 15:39:44 user nova-compute[74421]: INFO nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Took 6.56 seconds to spawn the instance on the hypervisor.
Oct 23 15:39:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:39:44 user nova-compute[74421]: INFO nova.compute.manager [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Took 7.92 seconds to build instance.
Oct 23 15:39:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8000b032-f3f1-4281-8145-c161b86460a1 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.086s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-2d774b72-7669-455c-bdc3-5b721d479a0d req-24e1d23f-a308-481e-b83f-07bd40e5314b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2d774b72-7669-455c-bdc3-5b721d479a0d req-24e1d23f-a308-481e-b83f-07bd40e5314b service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2d774b72-7669-455c-bdc3-5b721d479a0d req-24e1d23f-a308-481e-b83f-07bd40e5314b service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2d774b72-7669-455c-bdc3-5b721d479a0d req-24e1d23f-a308-481e-b83f-07bd40e5314b service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-2d774b72-7669-455c-bdc3-5b721d479a0d req-24e1d23f-a308-481e-b83f-07bd40e5314b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:45 user nova-compute[74421]: WARNING nova.compute.manager [req-2d774b72-7669-455c-bdc3-5b721d479a0d req-24e1d23f-a308-481e-b83f-07bd40e5314b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state active and task_state rescuing.
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "0d259e70-884d-49c7-9a98-d318ecb01841" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:46 user nova-compute[74421]: INFO nova.compute.manager [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Terminating instance
Oct 23 15:39:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Instance destroyed successfully.
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.objects.instance [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'resources' on Instance uuid 0d259e70-884d-49c7-9a98-d318ecb01841 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:30:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1318179009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1318179009',id=26,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-o0gpmfw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:32:20Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=0d259e70-884d-49c7-9a98-d318ecb01841,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "address": "fa:16:3e:95:33:19", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape531b9fc-9d", "ovs_interfaceid": "e531b9fc-9d68-4e13-b9bb-028aaff81aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG os_vif [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape531b9fc-9d, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=065ac0db-520b-46e7-9eed-e4e663d3b770) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:47 user nova-compute[74421]: WARNING nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state active and task_state rescuing.
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:47 user nova-compute[74421]: WARNING nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state active and task_state rescuing.
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-unplugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-unplugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-39b8da57-8f01-42bd-a508-938fc32abebb req-f078d588-62ad-4989-8315-988b3bf8385b service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-unplugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:39:47 user nova-compute[74421]: INFO os_vif [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:19,bridge_name='br-int',has_traffic_filtering=True,id=e531b9fc-9d68-4e13-b9bb-028aaff81aba,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape531b9fc-9d')
Oct 23 15:39:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Deleting instance files /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841_del
Oct 23 15:39:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Deletion of /opt/stack/data/nova/instances/0d259e70-884d-49c7-9a98-d318ecb01841_del complete
Oct 23 15:39:47 user nova-compute[74421]: INFO nova.compute.manager [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:47 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6958440f-1c81-4ad5-8468-00beb7bbeae8 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:39:48 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Took 0.90 seconds to deallocate network for instance.
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:48 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Deleted allocations for instance 0d259e70-884d-49c7-9a98-d318ecb01841
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-85b696c9-a194-49bd-9d95-ce630a92b40a tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "0d259e70-884d-49c7-9a98-d318ecb01841" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.674s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:49 user nova-compute[74421]: WARNING nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received unexpected event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with vm_state deleted and task_state None.
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:49 user nova-compute[74421]: WARNING nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received unexpected event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with vm_state deleted and task_state None.
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:49 user nova-compute[74421]: WARNING nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received unexpected event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with vm_state deleted and task_state None.
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Acquiring lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] Lock "0d259e70-884d-49c7-9a98-d318ecb01841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] No waiting events found dispatching network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:39:49 user nova-compute[74421]: WARNING nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received unexpected event network-vif-plugged-e531b9fc-9d68-4e13-b9bb-028aaff81aba for instance with vm_state deleted and task_state None.
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-2e01221e-91d6-4c9c-b976-ed253b71bd41 req-69efd4f5-2dd2-411a-b926-14889ea447ce service nova] [instance: 0d259e70-884d-49c7-9a98-d318ecb01841] Received event network-vif-deleted-e531b9fc-9d68-4e13-b9bb-028aaff81aba {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:53 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:53 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7639MB free_disk=24.864994049072266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 7767aaf1-9958-446c-ba3f-708fddb78750 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 71f11170-4d47-419e-a067-dbc82352a8b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance a741ac42-e881-435c-b7e7-9ea98a9ff132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8e63a09b-624d-4bf2-8d8a-77225bd34a8d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:39:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:39:54 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:39:54 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:39:54 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:39:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:39:55 user nova-compute[74421]: INFO nova.compute.claims [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Claim successful on node user
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:39:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.policy [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53583412174b40f880bac0c01314b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5332171df4d37a5d29e9f39da22d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:39:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Creating image(s)
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "/opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "/opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk 1073741824" returned: 0 in 0.050s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Successfully created port: e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Cannot resize image /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Ensure instance console log exists: /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'pci_requests' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:39:57 user nova-compute[74421]: INFO nova.compute.claims [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Claim successful on node user
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Successfully updated port: e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "refresh_cache-5c0a8a34-9471-4832-8652-cfa129c8114f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquired lock "refresh_cache-5c0a8a34-9471-4832-8652-cfa129c8114f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-changed-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Refreshing instance network info cache due to event network-changed-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] Acquiring lock "refresh_cache-5c0a8a34-9471-4832-8652-cfa129c8114f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:39:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:57 user nova-compute[74421]: INFO nova.network.neutron [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Updating instance_info_cache with network_info: [{"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Releasing lock "refresh_cache-5c0a8a34-9471-4832-8652-cfa129c8114f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Instance network_info: |[{"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] Acquired lock "refresh_cache-5c0a8a34-9471-4832-8652-cfa129c8114f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Refreshing network info cache for port e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Start _get_guest_xml network_info=[{"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:39:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:39:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1831100185',display_name='tempest-VolumesNegativeTest-instance-1831100185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1831100185',id=38,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca5332171df4d37a5d29e9f39da22d8',ramdisk_id='',reservation_id='r-e068mtk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-771010811',owner_user_name='tempest-VolumesNegativeTest-771010811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:39:56Z,user_data=None,user_id='53583412174b40f880bac0c01314b070',uuid=5c0a8a34-9471-4832-8652-cfa129c8114f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Converting VIF {"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c0a8a34-9471-4832-8652-cfa129c8114f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:39:58 user nova-compute[74421]:   <uuid>5c0a8a34-9471-4832-8652-cfa129c8114f</uuid>
Oct 23 15:39:58 user nova-compute[74421]:   <name>instance-00000026</name>
Oct 23 15:39:58 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:39:58 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:39:58 user nova-compute[74421]:   <metadata>
Oct 23 15:39:58 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:39:58 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:39:58 user nova-compute[74421]:       <nova:name>tempest-VolumesNegativeTest-instance-1831100185</nova:name>
Oct 23 15:39:58 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:39:58</nova:creationTime>
Oct 23 15:39:58 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:39:58 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:39:58 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:39:58 user nova-compute[74421]:       <nova:owner>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:user uuid="53583412174b40f880bac0c01314b070">tempest-VolumesNegativeTest-771010811-project-member</nova:user>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:project uuid="cca5332171df4d37a5d29e9f39da22d8">tempest-VolumesNegativeTest-771010811</nova:project>
Oct 23 15:39:58 user nova-compute[74421]:       </nova:owner>
Oct 23 15:39:58 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:39:58 user nova-compute[74421]:       <nova:ports>
Oct 23 15:39:58 user nova-compute[74421]:         <nova:port uuid="e6ed8b39-264c-4474-b1b6-1c43cdd5bf92">
Oct 23 15:39:58 user nova-compute[74421]:           <nova:ip type="fixed" address="192.168.233.234" ipVersion="4"/>
Oct 23 15:39:58 user nova-compute[74421]:         </nova:port>
Oct 23 15:39:58 user nova-compute[74421]:       </nova:ports>
Oct 23 15:39:58 user nova-compute[74421]:     </nova:instance>
Oct 23 15:39:58 user nova-compute[74421]:   </metadata>
Oct 23 15:39:58 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:39:58 user nova-compute[74421]:     <system>
Oct 23 15:39:58 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:39:58 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:39:58 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:39:58 user nova-compute[74421]:       <entry name="serial">5c0a8a34-9471-4832-8652-cfa129c8114f</entry>
Oct 23 15:39:58 user nova-compute[74421]:       <entry name="uuid">5c0a8a34-9471-4832-8652-cfa129c8114f</entry>
Oct 23 15:39:58 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:39:58 user nova-compute[74421]:     </system>
Oct 23 15:39:58 user nova-compute[74421]:   </sysinfo>
Oct 23 15:39:58 user nova-compute[74421]:   <os>
Oct 23 15:39:58 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:39:58 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:39:58 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:39:58 user nova-compute[74421]:   </os>
Oct 23 15:39:58 user nova-compute[74421]:   <features>
Oct 23 15:39:58 user nova-compute[74421]:     <acpi/>
Oct 23 15:39:58 user nova-compute[74421]:     <apic/>
Oct 23 15:39:58 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:39:58 user nova-compute[74421]:   </features>
Oct 23 15:39:58 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:39:58 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:39:58 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:39:58 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:39:58 user nova-compute[74421]:   </clock>
Oct 23 15:39:58 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:39:58 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:39:58 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:39:58 user nova-compute[74421]:   </cpu>
Oct 23 15:39:58 user nova-compute[74421]:   <devices>
Oct 23 15:39:58 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:39:58 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:39:58 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk"/>
Oct 23 15:39:58 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:39:58 user nova-compute[74421]:     </disk>
Oct 23 15:39:58 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:39:58 user nova-compute[74421]:       <mac address="fa:16:3e:d8:a6:07"/>
Oct 23 15:39:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:39:58 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:39:58 user nova-compute[74421]:       <target dev="tape6ed8b39-26"/>
Oct 23 15:39:58 user nova-compute[74421]:     </interface>
Oct 23 15:39:58 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:39:58 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/console.log" append="off"/>
Oct 23 15:39:58 user nova-compute[74421]:     </serial>
Oct 23 15:39:58 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:39:58 user nova-compute[74421]:     <video>
Oct 23 15:39:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:39:58 user nova-compute[74421]:     </video>
Oct 23 15:39:58 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:39:58 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:39:58 user nova-compute[74421]:     </rng>
Oct 23 15:39:58 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:39:58 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:39:58 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:39:58 user nova-compute[74421]:     </memballoon>
Oct 23 15:39:58 user nova-compute[74421]:   </devices>
Oct 23 15:39:58 user nova-compute[74421]: </domain>
Oct 23 15:39:58 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:39:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1831100185',display_name='tempest-VolumesNegativeTest-instance-1831100185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1831100185',id=38,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca5332171df4d37a5d29e9f39da22d8',ramdisk_id='',reservation_id='r-e068mtk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-771010811',owner_user_name='tempest-VolumesNegativeTest-771010811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:39:56Z,user_data=None,user_id='53583412174b40f880bac0c01314b070',uuid=5c0a8a34-9471-4832-8652-cfa129c8114f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Converting VIF {"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG os_vif [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4054e7f-94d4-58bf-a2c2-8ad2f6368548', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.compute.manager [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing instance network info cache due to event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6ed8b39-26, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6ed8b39-26, col_values=(('qos', UUID('e80eed22-55c3-4148-9ecc-b04711d4971e')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6ed8b39-26, col_values=(('external_ids', {'iface-id': 'e6ed8b39-264c-4474-b1b6-1c43cdd5bf92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:a6:07', 'vm-uuid': '5c0a8a34-9471-4832-8652-cfa129c8114f'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:39:58 user nova-compute[74421]: INFO os_vif [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26')
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] No VIF found with MAC fa:16:3e:d8:a6:07, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Updated VIF entry in instance network info cache for port e6ed8b39-264c-4474-b1b6-1c43cdd5bf92. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Updating instance_info_cache with network_info: [{"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-97ece3ef-0099-4714-8dcb-52455873eac3 req-169ac818-5dd6-46bd-a62d-060594ccb3bd service nova] Releasing lock "refresh_cache-5c0a8a34-9471-4832-8652-cfa129c8114f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:39:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Creating image(s)
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Ensure instance console log exists: /opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Start _get_guest_xml network_info=[{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '9c0fa038-28a4-4cd4-8daf-78aa741db41b', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e63a09b-624d-4bf2-8d8a-77225bd34a8d', 'attached_at': '', 'detached_at': '', 'volume_id': '1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'serial': '1ce69ea3-e893-4552-b7d8-ab9396edad6c'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:58 user nova-compute[74421]: DEBUG nova.network.neutron [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:39:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:58 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.objects.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Object Instance<8e63a09b-624d-4bf2-8d8a-77225bd34a8d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:39:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:59 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:39:59 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0d1efa-ba1d-41a3-afa3-1354de819089]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:39:59 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd7286c-d606-448e-9f63-4835e9301dc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c] added
Oct 23 15:39:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a413acf-9d54-4d5f-92f3-f434380f1538]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c55d71-684a-4777-9f48-0e147ed84390]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFvUWLYd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFvUWLYd" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac726ee-295e-4525-97c7-997bfebff29e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wFvUWLYd'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[16873d3c-4529-46e7-a3e0-70bcdeb13546]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1076f9-1a56-4b4b-b790-1642e56cfa73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ef049d-96f8-44a8-ba55-ddfd18267c06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]
Oct 23 15:39:59 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.
Oct 23 15:39:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[387c09fb-d8a0-4ce4-be04-dd4d94485c91]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updated VIF entry in instance network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41286fa-72a5-46e4-ab5d-8eaf161dccfe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:39:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:39:59 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:39:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.491s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d39c3d58-a3ff-4c6e-80fd-0f5d38bf3fac req-2f79d5c2-7989-4ff2-8321-c9d9142d0681 service nova] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[781151fd-b632-42ef-a3a6-6a40cf50a79a]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:39:59 user nova-compute[74421]: INFO nova.compute.manager [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Detaching volume d001a819-a587-430a-a818-3b996cb6d03b
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-changed-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Refreshing instance network info cache due to event network-changed-6d29cd30-7b4c-4af3-a083-be2db7680c00. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] Acquiring lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] Acquired lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:39:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Refreshing network info cache for port 6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:39:59 user nova-compute[74421]: INFO nova.virt.block_device [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Attempting to driver detach volume d001a819-a587-430a-a818-3b996cb6d03b from mountpoint /dev/vdb
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Attempting to detach device vdb from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:40:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:40:00 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:40:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:40:00 user nova-compute[74421]:   <serial>d001a819-a587-430a-a818-3b996cb6d03b</serial>
Oct 23 15:40:00 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:40:00 user nova-compute[74421]: </disk>
Oct 23 15:40:00 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Successfully detached device vdb from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the persistent domain config.
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:40:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:40:00 user nova-compute[74421]:   <source dev="/dev/sdc"/>
Oct 23 15:40:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:40:00 user nova-compute[74421]:   <serial>d001a819-a587-430a-a818-3b996cb6d03b</serial>
Oct 23 15:40:00 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:40:00 user nova-compute[74421]: </disk>
Oct 23 15:40:00 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.objects.instance [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'flavor' on Instance uuid 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Ignoring supplied device name: /dev/vdb
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:00 user nova-compute[74421]: INFO nova.compute.manager [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Attaching volume 608b2f33-eb3b-4327-a82a-380357fe4a87 to /dev/vdb
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.utils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updated VIF entry in instance network info cache for port 6d29cd30-7b4c-4af3-a083-be2db7680c00. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updating instance_info_cache with network_info: [{"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ad4fa-16db-4d41-b06f-bac028b8632a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a1d8c7db-d630-4af4-97ab-ebc9d5ea39af req-6a80e7a5-72b3-4877-b134-181ee8bbf289 service nova] Releasing lock "refresh_cache-794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ede7e4-fb31-4526-9d09-5862c0c82e8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04604759-1732-47ca-941b-6b66763f158e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd73eca-576c-4d0a-91fb-fa7ad2c86c0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] <== connect_volume: return (1552ms) {'type': 'block', 'scsi_wwn': '23164663238353337', 'path': '/dev/sdg'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164663238353337', 'path': '/dev/sdg'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:40:00 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:40:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c96ef-e77c-47a8-bc6f-4c8018c9d253]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_brick.utils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updating existing volume attachment record: 7bb58b85-7dba-4c99-a994-e5d6648f262d {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-474494279',display_name='tempest-TestShelveInstance-server-474494279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-474494279',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1680132638',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:36:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='79f5d845cfc547f69e20081a6e42c3eb',ramdisk_id='',reservation_id='r-86c22pno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1665380191',owner_user_name='tempest-TestShelveInstance-1665380191-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:39:36Z,user_data=None,user_id='cac7200691824d7ca5a62ae55959832d',uuid=8e63a09b-624d-4bf2-8d8a-77225bd34a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converting VIF {"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.objects.base [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Object Instance<8e63a09b-624d-4bf2-8d8a-77225bd34a8d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:40:00 user nova-compute[74421]:   <uuid>8e63a09b-624d-4bf2-8d8a-77225bd34a8d</uuid>
Oct 23 15:40:00 user nova-compute[74421]:   <name>instance-00000021</name>
Oct 23 15:40:00 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:40:00 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:40:00 user nova-compute[74421]:   <metadata>
Oct 23 15:40:00 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:40:00 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:40:00 user nova-compute[74421]:       <nova:name>tempest-TestShelveInstance-server-474494279</nova:name>
Oct 23 15:40:00 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:39:58</nova:creationTime>
Oct 23 15:40:00 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:40:00 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:40:00 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:40:00 user nova-compute[74421]:       <nova:owner>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:user uuid="cac7200691824d7ca5a62ae55959832d">tempest-TestShelveInstance-1665380191-project-member</nova:user>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:project uuid="79f5d845cfc547f69e20081a6e42c3eb">tempest-TestShelveInstance-1665380191</nova:project>
Oct 23 15:40:00 user nova-compute[74421]:       </nova:owner>
Oct 23 15:40:00 user nova-compute[74421]:       <nova:ports>
Oct 23 15:40:00 user nova-compute[74421]:         <nova:port uuid="c99a03a6-437c-4469-9bf8-95ba5b7d6ae4">
Oct 23 15:40:00 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:40:00 user nova-compute[74421]:         </nova:port>
Oct 23 15:40:00 user nova-compute[74421]:       </nova:ports>
Oct 23 15:40:00 user nova-compute[74421]:     </nova:instance>
Oct 23 15:40:00 user nova-compute[74421]:   </metadata>
Oct 23 15:40:00 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:40:00 user nova-compute[74421]:     <system>
Oct 23 15:40:00 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:40:00 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:40:00 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:40:00 user nova-compute[74421]:       <entry name="serial">8e63a09b-624d-4bf2-8d8a-77225bd34a8d</entry>
Oct 23 15:40:00 user nova-compute[74421]:       <entry name="uuid">8e63a09b-624d-4bf2-8d8a-77225bd34a8d</entry>
Oct 23 15:40:00 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:40:00 user nova-compute[74421]:     </system>
Oct 23 15:40:00 user nova-compute[74421]:   </sysinfo>
Oct 23 15:40:00 user nova-compute[74421]:   <os>
Oct 23 15:40:00 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:40:00 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:40:00 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:40:00 user nova-compute[74421]:   </os>
Oct 23 15:40:00 user nova-compute[74421]:   <features>
Oct 23 15:40:00 user nova-compute[74421]:     <acpi/>
Oct 23 15:40:00 user nova-compute[74421]:     <apic/>
Oct 23 15:40:00 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:40:00 user nova-compute[74421]:   </features>
Oct 23 15:40:00 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:40:00 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:40:00 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:40:00 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:40:00 user nova-compute[74421]:   </clock>
Oct 23 15:40:00 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:40:00 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:40:00 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:40:00 user nova-compute[74421]:   </cpu>
Oct 23 15:40:00 user nova-compute[74421]:   <devices>
Oct 23 15:40:00 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:40:00 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:40:00 user nova-compute[74421]:       <source dev="/dev/sdg"/>
Oct 23 15:40:00 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:40:00 user nova-compute[74421]:       <serial>1ce69ea3-e893-4552-b7d8-ab9396edad6c</serial>
Oct 23 15:40:00 user nova-compute[74421]:     </disk>
Oct 23 15:40:00 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:40:00 user nova-compute[74421]:       <mac address="fa:16:3e:98:76:0c"/>
Oct 23 15:40:00 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:40:00 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:40:00 user nova-compute[74421]:       <target dev="tapc99a03a6-43"/>
Oct 23 15:40:00 user nova-compute[74421]:     </interface>
Oct 23 15:40:00 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:40:00 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d/console.log" append="off"/>
Oct 23 15:40:00 user nova-compute[74421]:     </serial>
Oct 23 15:40:00 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:40:00 user nova-compute[74421]:     <video>
Oct 23 15:40:00 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:40:00 user nova-compute[74421]:     </video>
Oct 23 15:40:00 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:40:00 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:40:00 user nova-compute[74421]:     </rng>
Oct 23 15:40:00 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:40:00 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:40:00 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:40:00 user nova-compute[74421]:     </memballoon>
Oct 23 15:40:00 user nova-compute[74421]:   </devices>
Oct 23 15:40:00 user nova-compute[74421]: </domain>
Oct 23 15:40:00 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-474494279',display_name='tempest-TestShelveInstance-server-474494279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-474494279',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1680132638',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:36:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='79f5d845cfc547f69e20081a6e42c3eb',ramdisk_id='',reservation_id='r-86c22pno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1665380191',owner_user_name='tempest-TestShelveInstance-1665380191-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:39:36Z,user_data=None,user_id='cac7200691824d7ca5a62ae55959832d',uuid=8e63a09b-624d-4bf2-8d8a-77225bd34a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converting VIF {"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG os_vif [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '034a26f5-7020-5b4a-be1b-d4190e196572', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc99a03a6-43, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc99a03a6-43, col_values=(('qos', UUID('85ee3542-7344-4357-8af2-070bdc5d1dd9')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc99a03a6-43, col_values=(('external_ids', {'iface-id': 'c99a03a6-437c-4469-9bf8-95ba5b7d6ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:76:0c', 'vm-uuid': '8e63a09b-624d-4bf2-8d8a-77225bd34a8d'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:00 user nova-compute[74421]: INFO os_vif [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43')
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:40:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] No VIF found with MAC fa:16:3e:98:76:0c, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] No waiting events found dispatching network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:01 user nova-compute[74421]: WARNING nova.compute.manager [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received unexpected event network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 for instance with vm_state building and task_state spawning.
Oct 23 15:40:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] No waiting events found dispatching network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:01 user nova-compute[74421]: WARNING nova.compute.manager [req-d340fb1c-7e31-442a-88ed-9b57e03f6bdf req-2b01489e-7a93-4d16-b290-c36a1f9efe32 service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received unexpected event network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 for instance with vm_state building and task_state spawning.
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-b15679ff-82dc-47b7-8375-aaa8627a309a req-d8b24ec6-f8a9-4d4f-804b-04a3431e7dd2 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b15679ff-82dc-47b7-8375-aaa8627a309a req-d8b24ec6-f8a9-4d4f-804b-04a3431e7dd2 service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b15679ff-82dc-47b7-8375-aaa8627a309a req-d8b24ec6-f8a9-4d4f-804b-04a3431e7dd2 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b15679ff-82dc-47b7-8375-aaa8627a309a req-d8b24ec6-f8a9-4d4f-804b-04a3431e7dd2 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-b15679ff-82dc-47b7-8375-aaa8627a309a req-d8b24ec6-f8a9-4d4f-804b-04a3431e7dd2 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:02 user nova-compute[74421]: WARNING nova.compute.manager [req-b15679ff-82dc-47b7-8375-aaa8627a309a req-d8b24ec6-f8a9-4d4f-804b-04a3431e7dd2 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:40:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Instance spawned successfully.
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: INFO nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Took 6.50 seconds to spawn the instance on the hypervisor.
Oct 23 15:40:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:40:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:02 user nova-compute[74421]: INFO nova.compute.manager [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Took 7.49 seconds to build instance.
Oct 23 15:40:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5c89e4e4-ea0c-49c6-9a93-912ebac42b1e tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.624s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:40:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance spawned successfully.
Oct 23 15:40:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e181ee69-02a4-4f92-8f02-6c5e27a5af64 tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.266s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-c7b1d4be-2041-4185-a743-749d1a76ed82 req-b0394bba-9f0c-404c-b30f-912e854b7adc service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c7b1d4be-2041-4185-a743-749d1a76ed82 req-b0394bba-9f0c-404c-b30f-912e854b7adc service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c7b1d4be-2041-4185-a743-749d1a76ed82 req-b0394bba-9f0c-404c-b30f-912e854b7adc service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c7b1d4be-2041-4185-a743-749d1a76ed82 req-b0394bba-9f0c-404c-b30f-912e854b7adc service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-c7b1d4be-2041-4185-a743-749d1a76ed82 req-b0394bba-9f0c-404c-b30f-912e854b7adc service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:04 user nova-compute[74421]: WARNING nova.compute.manager [req-c7b1d4be-2041-4185-a743-749d1a76ed82 req-b0394bba-9f0c-404c-b30f-912e854b7adc service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state active and task_state None.
Oct 23 15:40:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLhYSeXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:40:19 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:40:19 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:40:19 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddaf80e-9e78-4ad2-bdbc-35ede9ea2b38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:40:19 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff14956-2839-497a-8f91-3f9131d1427a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87] added
Oct 23 15:40:19 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a21be9-2594-4175-ba9b-ae76e99851f5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1231b43-564d-4b2b-8f8f-84e870d1b62f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLhYSeXs {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLhYSeXs" returned: 0 in 0.046s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2af57-9ecd-460f-b543-cf56d34e1000]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLhYSeXs'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b2fd82-32fc-4f27-a84a-741a6aac7bac]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d4016-c755-45c7-bd9e-d2a85c1d4381]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:19 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:19 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:19 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:40:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:20 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 is timed out.
Oct 23 15:40:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Successfully detached device vdb from instance a741ac42-e881-435c-b7e7-9ea98a9ff132 from the live domain config.
Oct 23 15:40:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRvrzZUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:40:20 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --login" returned: 0 in 1.079s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc154100-9f7c-4f87-a946-5e503e06adde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260]
Oct 23 15:40:20 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260] successful.
Oct 23 15:40:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cab459f-6035-4bf2-bcc8-f75a1532926f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7517685-0a8e-466d-a45e-f2ddb2abe037]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:20 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:20 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.331s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53dcf33-4882-4cb6-9187-e2750750a2ef]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:40:20 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLhYSeXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.364s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== connect_volume: return (2365ms) {'type': 'block', 'scsi_wwn': '23361343664393836', 'path': '/dev/sdh'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361343664393836', 'path': '/dev/sdh'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.123s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG nova.objects.instance [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'flavor' on Instance uuid 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b359343-43f0-486a-a53e-2644b29b3b28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:40:21 user nova-compute[74421]: No targets found.
Oct 23 15:40:21 user nova-compute[74421]: iSNS:
Oct 23 15:40:21 user nova-compute[74421]: No targets found.
Oct 23 15:40:21 user nova-compute[74421]: STATIC:
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c
Oct 23 15:40:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:21 user nova-compute[74421]: FIRMWARE:
Oct 23 15:40:21 user nova-compute[74421]: No targets found.
Oct 23 15:40:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:40:21 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:40:21 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:40:21 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:40:21 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:40:21 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:40:21 user nova-compute[74421]:   <serial>608b2f33-eb3b-4327-a82a-380357fe4a87</serial>
Oct 23 15:40:21 user nova-compute[74421]: </disk>
Oct 23 15:40:21 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[abab3360-0b4a-49d7-aa40-388d988e4699]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fadb46a-c715-4d87-857f-e8e5085cd01d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:21 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2480f73e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a4404d-36ca-471e-9804-d6ddaa67a51f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e518f42-0ac1-4b07-a6c9-60530cbf8afc]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff26a90-9390-4526-b643-e328c4222030]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c04d5a-b2c8-4485-942f-94c2a633ab49]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[477cdd5b-e341-4e2d-90ac-b4d185ff75e3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b123b348-6a5c-419e-9d31-557ab685307c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260]
Oct 23 15:40:22 user nova-compute[74421]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b, portal: 172.16.0.220,3260] successful.
Oct 23 15:40:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d001a819-a587-430a-a818-3b996cb6d03b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a475db6-9909-48db-a772-0aa1c93d046b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] <== disconnect_volume: return (1437ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No VIF found with MAC fa:16:3e:d4:ad:f9, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:40:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-da405c15-5acc-4b31-8a67-ff552db73c12 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.039s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:23 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'flavor' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e0363664-df27-4e17-a22f-af58f84b80ff tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.254s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:34 user nova-compute[74421]: INFO nova.compute.manager [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Terminating instance
Oct 23 15:40:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-de94fded-902e-4f31-8616-5acb742c1c83 req-7063abca-cbb4-4020-8ab3-d95d7fde72ea service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-unplugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de94fded-902e-4f31-8616-5acb742c1c83 req-7063abca-cbb4-4020-8ab3-d95d7fde72ea service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de94fded-902e-4f31-8616-5acb742c1c83 req-7063abca-cbb4-4020-8ab3-d95d7fde72ea service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-de94fded-902e-4f31-8616-5acb742c1c83 req-7063abca-cbb4-4020-8ab3-d95d7fde72ea service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-de94fded-902e-4f31-8616-5acb742c1c83 req-7063abca-cbb4-4020-8ab3-d95d7fde72ea service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-unplugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-de94fded-902e-4f31-8616-5acb742c1c83 req-7063abca-cbb4-4020-8ab3-d95d7fde72ea service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-unplugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Instance destroyed successfully.
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.objects.instance [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'resources' on Instance uuid 71f11170-4d47-419e-a067-dbc82352a8b9 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323723003',display_name='tempest-ServerActionsTestOtherA-server-1323723003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323723003',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:36:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-9v52yphd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=71f11170-4d47-419e-a067-dbc82352a8b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "97945e10-06c5-453a-9e05-359a5b48ae0b", "address": "fa:16:3e:88:b3:1d", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97945e10-06", "ovs_interfaceid": "97945e10-06c5-453a-9e05-359a5b48ae0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_vif [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97945e10-06, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99fa4964-8b7d-489b-9de7-a9d5a196f241) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:40:35 user nova-compute[74421]: INFO os_vif [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=97945e10-06c5-453a-9e05-359a5b48ae0b,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97945e10-06')
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMpidyGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:40:35 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[052043b2-3be8-4e48-8d7d-c008de6944ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:40:35 user nova-compute[74421]: No targets found.
Oct 23 15:40:35 user nova-compute[74421]: iSNS:
Oct 23 15:40:35 user nova-compute[74421]: No targets found.
Oct 23 15:40:35 user nova-compute[74421]: STATIC:
Oct 23 15:40:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:40:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:40:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395
Oct 23 15:40:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:40:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:40:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c
Oct 23 15:40:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:35 user nova-compute[74421]: FIRMWARE:
Oct 23 15:40:35 user nova-compute[74421]: No targets found.
Oct 23 15:40:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:40:35 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:40:35 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[37295f49-b6b5-4003-9bc1-2916a5a4b25a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5dbc5e-7876-4724-ab26-856f499da833]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:35 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24787876d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd08e7d-a5dd-4b6f-8033-d2475c622c8d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a49a1b1-d873-46d9-aa93-174982b97d03]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c8ae10-618f-4a5a-bd29-053bb93f90de]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9bf222-64bb-4924-96ca-ac3a822c2fa4]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9fa78306-24c9de5fdd8c27a4', '/dev/disk/by-id/scsi-23234633964653566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9fa78306') {{(pid=85617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b313795-1722-42a3-8d45-736dd9b7b846]: (4, None) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece431ab-b506-4275-921e-f6408c01cdef]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc406ec4-0046-4739-9b7c-446192bd86c5]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260]
Oct 23 15:40:35 user nova-compute[74421]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395, portal: 172.16.0.220,3260] successful.
Oct 23 15:40:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:530d2ac0-ffa9-453e-8c0d-9b292e1ec395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[359115a8-62fb-4aff-ae74-d9db2bf216c1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] <== disconnect_volume: return (333ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:40:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Deleting instance files /opt/stack/data/nova/instances/71f11170-4d47-419e-a067-dbc82352a8b9_del
Oct 23 15:40:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Deletion of /opt/stack/data/nova/instances/71f11170-4d47-419e-a067-dbc82352a8b9_del complete
Oct 23 15:40:35 user nova-compute[74421]: INFO nova.compute.manager [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 23 15:40:35 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:40:35 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:40:36 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:36 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Took 0.86 seconds to deallocate network for instance.
Oct 23 15:40:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-1d0b93a5-ac20-4a3e-a8a6-0339775484c2 req-8f7f8240-fdfb-42bb-8319-86b67d10d919 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-deleted-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-f55d9669-bb8c-44e1-821a-cc42b188d00d req-e2bf1840-4601-43e1-a514-e986db3099a6 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f55d9669-bb8c-44e1-821a-cc42b188d00d req-e2bf1840-4601-43e1-a514-e986db3099a6 service nova] Acquiring lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f55d9669-bb8c-44e1-821a-cc42b188d00d req-e2bf1840-4601-43e1-a514-e986db3099a6 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f55d9669-bb8c-44e1-821a-cc42b188d00d req-e2bf1840-4601-43e1-a514-e986db3099a6 service nova] Lock "71f11170-4d47-419e-a067-dbc82352a8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-f55d9669-bb8c-44e1-821a-cc42b188d00d req-e2bf1840-4601-43e1-a514-e986db3099a6 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] No waiting events found dispatching network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:36 user nova-compute[74421]: WARNING nova.compute.manager [req-f55d9669-bb8c-44e1-821a-cc42b188d00d req-e2bf1840-4601-43e1-a514-e986db3099a6 service nova] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Received unexpected event network-vif-plugged-97945e10-06c5-453a-9e05-359a5b48ae0b for instance with vm_state active and task_state deleting.
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:37 user nova-compute[74421]: INFO nova.compute.manager [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Terminating instance
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: INFO nova.compute.manager [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Took 0.93 seconds to detach 1 volumes for instance.
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 71f11170-4d47-419e-a067-dbc82352a8b9] Deleting volume: 530d2ac0-ffa9-453e-8c0d-9b292e1ec395 {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0a59267-bc81-41c0-afbf-af7ed6340c7e req-1c0e790f-a76f-4099-81d5-fd0d968b36fa service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0a59267-bc81-41c0-afbf-af7ed6340c7e req-1c0e790f-a76f-4099-81d5-fd0d968b36fa service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0a59267-bc81-41c0-afbf-af7ed6340c7e req-1c0e790f-a76f-4099-81d5-fd0d968b36fa service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f0a59267-bc81-41c0-afbf-af7ed6340c7e req-1c0e790f-a76f-4099-81d5-fd0d968b36fa service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0a59267-bc81-41c0-afbf-af7ed6340c7e req-1c0e790f-a76f-4099-81d5-fd0d968b36fa service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-f0a59267-bc81-41c0-afbf-af7ed6340c7e req-1c0e790f-a76f-4099-81d5-fd0d968b36fa service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-unplugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:40:37 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Instance destroyed successfully.
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'resources' on Instance uuid 7767aaf1-9958-446c-ba3f-708fddb78750 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-776177048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-776177048',id=14,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:26:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-736t0x06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:28:39Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=7767aaf1-9958-446c-ba3f-708fddb78750,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "address": "fa:16:3e:e5:c7:76", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13260e7c-d2", "ovs_interfaceid": "13260e7c-d231-43bd-aa15-f5d4f5f3040e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG os_vif [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13260e7c-d2, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c44f9d68-7363-4776-b842-17150096caa1) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:37 user nova-compute[74421]: INFO os_vif [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c7:76,bridge_name='br-int',has_traffic_filtering=True,id=13260e7c-d231-43bd-aa15-f5d4f5f3040e,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13260e7c-d2')
Oct 23 15:40:37 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUpzDew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:40:37 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:40:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:40:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[305de574-2ed9-492e-a272-3a458506aefa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:40:38 user nova-compute[74421]: No targets found.
Oct 23 15:40:38 user nova-compute[74421]: iSNS:
Oct 23 15:40:38 user nova-compute[74421]: No targets found.
Oct 23 15:40:38 user nova-compute[74421]: STATIC:
Oct 23 15:40:38 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4
Oct 23 15:40:38 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:38 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:38 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:40:38 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:38 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:38 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:40:38 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:38 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:38 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:40:38 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:38 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:38 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c
Oct 23 15:40:38 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:40:38 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:40:38 user nova-compute[74421]: FIRMWARE:
Oct 23 15:40:38 user nova-compute[74421]: No targets found.
Oct 23 15:40:38 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:40:38 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:40:38 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cac778-5ce6-4679-8471-4e7191641eae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f2f040-72ec-4d63-8e7c-aec642919679]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:38 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:40:38 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:40:38 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782a7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4'): ({'sde'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Removing single pathed devices sde {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac94ff-d465-4391-8b5b-fb7b72b0a0c5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Deleted allocations for instance 71f11170-4d47-419e-a067-dbc82352a8b9
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba2c036-e1ee-4810-9189-f5454e01c84b]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Flushing IO for device /dev/sde {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1fb95-4469-46e2-919a-5b4437ecf213]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db06ac-7446-4458-8b19-d325db666465]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] SCSI volumes sde have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3a85fc84-b0cb-4e55-8eee-2559c6e40a57 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "71f11170-4d47-419e-a067-dbc82352a8b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.787s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab4dfc-7175-447f-928e-30b493fe3d70]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff907d07-71f4-47b7-b190-ce9029948dc6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260]
Oct 23 15:40:38 user nova-compute[74421]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4, portal: 172.16.0.220,3260] successful.
Oct 23 15:40:38 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a38b5b-d5aa-4e47-ba3d-17d4ef823ee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c800bd0c-1e22-4b4d-81d8-c5eef078228f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] <== disconnect_volume: return (347ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:40:38 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Deleting instance files /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750_del
Oct 23 15:40:38 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Deletion of /opt/stack/data/nova/instances/7767aaf1-9958-446c-ba3f-708fddb78750_del complete
Oct 23 15:40:38 user nova-compute[74421]: INFO nova.compute.manager [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 23 15:40:38 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:38 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Took 0.47 seconds to deallocate network for instance.
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-3384381e-f2aa-4da8-860b-403e7581b0c0 req-16280266-000a-43e0-b1bc-e2801acef4f7 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-deleted-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:38 user nova-compute[74421]: INFO nova.compute.manager [req-3384381e-f2aa-4da8-860b-403e7581b0c0 req-16280266-000a-43e0-b1bc-e2801acef4f7 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Neutron deleted interface 13260e7c-d231-43bd-aa15-f5d4f5f3040e; detaching it from the instance and deleting it from the info cache
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.network.neutron [req-3384381e-f2aa-4da8-860b-403e7581b0c0 req-16280266-000a-43e0-b1bc-e2801acef4f7 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-3384381e-f2aa-4da8-860b-403e7581b0c0 req-16280266-000a-43e0-b1bc-e2801acef4f7 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Detach interface failed, port_id=13260e7c-d231-43bd-aa15-f5d4f5f3040e, reason: Instance 7767aaf1-9958-446c-ba3f-708fddb78750 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:40:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-41526bd3-95e1-46d8-b4f8-72723c622ebc req-13fd4532-5eca-4227-98d1-09b475a4fe31 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-41526bd3-95e1-46d8-b4f8-72723c622ebc req-13fd4532-5eca-4227-98d1-09b475a4fe31 service nova] Acquiring lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-41526bd3-95e1-46d8-b4f8-72723c622ebc req-13fd4532-5eca-4227-98d1-09b475a4fe31 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-41526bd3-95e1-46d8-b4f8-72723c622ebc req-13fd4532-5eca-4227-98d1-09b475a4fe31 service nova] Lock "7767aaf1-9958-446c-ba3f-708fddb78750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-41526bd3-95e1-46d8-b4f8-72723c622ebc req-13fd4532-5eca-4227-98d1-09b475a4fe31 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] No waiting events found dispatching network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:39 user nova-compute[74421]: WARNING nova.compute.manager [req-41526bd3-95e1-46d8-b4f8-72723c622ebc req-13fd4532-5eca-4227-98d1-09b475a4fe31 service nova] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Received unexpected event network-vif-plugged-13260e7c-d231-43bd-aa15-f5d4f5f3040e for instance with vm_state active and task_state deleting.
Oct 23 15:40:40 user nova-compute[74421]: INFO nova.compute.manager [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 7767aaf1-9958-446c-ba3f-708fddb78750] Took 1.15 seconds to detach 1 volumes for instance.
Oct 23 15:40:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:40 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:40:40 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:40:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:40 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Deleted allocations for instance 7767aaf1-9958-446c-ba3f-708fddb78750
Oct 23 15:40:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b908fe63-d6b1-4770-b451-05e038053453 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "7767aaf1-9958-446c-ba3f-708fddb78750" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.471s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:45 user nova-compute[74421]: INFO nova.compute.manager [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Unrescuing
Oct 23 15:40:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'flavor' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-f725a76d-3d14-40a8-9808-b06122a31b41 req-e4378348-daa2-4a2d-9c70-6d803cae809b service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f725a76d-3d14-40a8-9808-b06122a31b41 req-e4378348-daa2-4a2d-9c70-6d803cae809b service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f725a76d-3d14-40a8-9808-b06122a31b41 req-e4378348-daa2-4a2d-9c70-6d803cae809b service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f725a76d-3d14-40a8-9808-b06122a31b41 req-e4378348-daa2-4a2d-9c70-6d803cae809b service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-f725a76d-3d14-40a8-9808-b06122a31b41 req-e4378348-daa2-4a2d-9c70-6d803cae809b service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:46 user nova-compute[74421]: WARNING nova.compute.manager [req-f725a76d-3d14-40a8-9808-b06122a31b41 req-e4378348-daa2-4a2d-9c70-6d803cae809b service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:40:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance destroyed successfully.
Oct 23 15:40:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:40:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:48 user nova-compute[74421]: WARNING nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing instance network info cache due to event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updated VIF entry in instance network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing instance network info cache due to event network-changed-3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:40:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Refreshing network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG nova.network.neutron [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updated VIF entry in instance network info cache for port 3732d23a-cecb-4ede-b572-d105a2c3dda3. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG nova.network.neutron [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:49 user nova-compute[74421]: DEBUG nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:49 user nova-compute[74421]: WARNING nova.compute.manager [req-67057f54-34f2-4757-99b8-9236ab48efea req-59deb855-02e3-4d8e-b7a9-8463a7f0591d service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ab26e641-37d3-4539-83d6-b5b08920f6df tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-31717993-1fe5-4b0c-b088-600f3fa7010e req-8b2e9461-79fc-4362-9b69-fe80f83acec4 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31717993-1fe5-4b0c-b088-600f3fa7010e req-8b2e9461-79fc-4362-9b69-fe80f83acec4 service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31717993-1fe5-4b0c-b088-600f3fa7010e req-8b2e9461-79fc-4362-9b69-fe80f83acec4 service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31717993-1fe5-4b0c-b088-600f3fa7010e req-8b2e9461-79fc-4362-9b69-fe80f83acec4 service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-31717993-1fe5-4b0c-b088-600f3fa7010e req-8b2e9461-79fc-4362-9b69-fe80f83acec4 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:50 user nova-compute[74421]: WARNING nova.compute.manager [req-31717993-1fe5-4b0c-b088-600f3fa7010e req-8b2e9461-79fc-4362-9b69-fe80f83acec4 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:50 user nova-compute[74421]: INFO nova.compute.manager [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Terminating instance
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-f46a2a62-034d-46e9-96ed-9d3826176a07 req-98e94f27-55de-48aa-b44c-5a82e731ae23 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-vif-unplugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f46a2a62-034d-46e9-96ed-9d3826176a07 req-98e94f27-55de-48aa-b44c-5a82e731ae23 service nova] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f46a2a62-034d-46e9-96ed-9d3826176a07 req-98e94f27-55de-48aa-b44c-5a82e731ae23 service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f46a2a62-034d-46e9-96ed-9d3826176a07 req-98e94f27-55de-48aa-b44c-5a82e731ae23 service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-f46a2a62-034d-46e9-96ed-9d3826176a07 req-98e94f27-55de-48aa-b44c-5a82e731ae23 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] No waiting events found dispatching network-vif-unplugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.compute.manager [req-f46a2a62-034d-46e9-96ed-9d3826176a07 req-98e94f27-55de-48aa-b44c-5a82e731ae23 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-vif-unplugged-df1c298d-0624-406b-b85e-60a6ea65bd88 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:40:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:51 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Instance destroyed successfully.
Oct 23 15:40:51 user nova-compute[74421]: DEBUG nova.objects.instance [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lazy-loading 'resources' on Instance uuid a741ac42-e881-435c-b7e7-9ea98a9ff132 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2000968635',display_name='tempest-TestServerVolumeAttachmentScenario-server-2000968635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2000968635',id=34,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/Lu2n2+cXY/SmJPkPJOEYCCrSvQhvSs+rorh0PqAqHKWi+oOd4VIztyojdrt34P4+Em2iFJ9DSWQDvolnvLLT8ZHbtk6VsfcgLY2rrj9GnIRNpVSzZVsopUmsPFgn60Q==',key_name='tempest-keypair-373919674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:36:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39defa9946e1491ab5db08b85f0cb59e',ramdisk_id='',reservation_id='r-izc4onnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-238568763',owner_user_name='tempest-TestServerVolumeAttachmentScenario-238568763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:36:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84d1dba9a5fa4300b89923bc0bbf4dec',uuid=a741ac42-e881-435c-b7e7-9ea98a9ff132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Converting VIF {"id": "df1c298d-0624-406b-b85e-60a6ea65bd88", "address": "fa:16:3e:61:b6:db", "network": {"id": "30d18cfa-89fd-43ea-a063-e229d09ac250", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1056031998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39defa9946e1491ab5db08b85f0cb59e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1c298d-06", "ovs_interfaceid": "df1c298d-0624-406b-b85e-60a6ea65bd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG os_vif [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf1c298d-06, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41f9ad61-0a8d-4ff4-8540-059032858b44) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:51 user nova-compute[74421]: INFO os_vif [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:b6:db,bridge_name='br-int',has_traffic_filtering=True,id=df1c298d-0624-406b-b85e-60a6ea65bd88,network=Network(30d18cfa-89fd-43ea-a063-e229d09ac250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1c298d-06')
Oct 23 15:40:51 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Deleting instance files /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132_del
Oct 23 15:40:51 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Deletion of /opt/stack/data/nova/instances/a741ac42-e881-435c-b7e7-9ea98a9ff132_del complete
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:51 user nova-compute[74421]: INFO nova.compute.manager [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:40:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid 'a741ac42-e881-435c-b7e7-9ea98a9ff132' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a741ac42-e881-435c-b7e7-9ea98a9ff132' (instance-00000022)
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:40:52 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Took 0.88 seconds to deallocate network for instance.
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] Acquiring lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] No waiting events found dispatching network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:40:52 user nova-compute[74421]: WARNING nova.compute.manager [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received unexpected event network-vif-plugged-df1c298d-0624-406b-b85e-60a6ea65bd88 for instance with vm_state deleted and task_state None.
Oct 23 15:40:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-8dc366c9-dba7-4a09-9b7a-dbbbc5030c20 req-f6ca49d6-2841-4af7-937d-5b22ff9ab629 service nova] [instance: a741ac42-e881-435c-b7e7-9ea98a9ff132] Received event network-vif-deleted-df1c298d-0624-406b-b85e-60a6ea65bd88 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.596s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:52 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Deleted allocations for instance a741ac42-e881-435c-b7e7-9ea98a9ff132
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-21fe28da-dc65-47eb-ab51-8189b776802e tempest-TestServerVolumeAttachmentScenario-238568763 tempest-TestServerVolumeAttachmentScenario-238568763-project-member] Lock "a741ac42-e881-435c-b7e7-9ea98a9ff132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:40:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:40:55 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:40:55 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=7339MB free_disk=24.796737670898438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 797f85e1-87ce-4295-8e14-19fd0919f2a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 83da5c9e-eac9-4f74-9c0c-b003b475415a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8e63a09b-624d-4bf2-8d8a-77225bd34a8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 5c0a8a34-9471-4832-8652-cfa129c8114f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:40:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:40:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:40:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:18 user nova-compute[74421]: INFO nova.compute.manager [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Detaching volume 44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:41:18 user nova-compute[74421]: INFO nova.virt.block_device [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Attempting to driver detach volume 44cc0772-bba2-4065-bf30-257fee16082e from mountpoint /dev/vdb
Oct 23 15:41:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Attempting to detach device vdb from instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:41:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:41:18 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:41:18 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:41:18 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:41:18 user nova-compute[74421]:   <serial>44cc0772-bba2-4065-bf30-257fee16082e</serial>
Oct 23 15:41:18 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:41:18 user nova-compute[74421]: </disk>
Oct 23 15:41:18 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:41:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Successfully detached device vdb from instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 from the persistent domain config.
Oct 23 15:41:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:41:18 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:41:18 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:41:18 user nova-compute[74421]:   <source dev="/dev/sdf"/>
Oct 23 15:41:18 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:41:18 user nova-compute[74421]:   <serial>44cc0772-bba2-4065-bf30-257fee16082e</serial>
Oct 23 15:41:18 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:41:18 user nova-compute[74421]: </disk>
Oct 23 15:41:18 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:41:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:41:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:21 user nova-compute[74421]: INFO nova.compute.manager [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Detaching volume 608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:41:21 user nova-compute[74421]: INFO nova.virt.block_device [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Attempting to driver detach volume 608b2f33-eb3b-4327-a82a-380357fe4a87 from mountpoint /dev/vdb
Oct 23 15:41:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Attempting to detach device vdb from instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:41:21 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:41:21 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:41:21 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:41:21 user nova-compute[74421]:   <serial>608b2f33-eb3b-4327-a82a-380357fe4a87</serial>
Oct 23 15:41:21 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:41:21 user nova-compute[74421]: </disk>
Oct 23 15:41:21 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:41:21 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully detached device vdb from instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e from the persistent domain config.
Oct 23 15:41:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:41:21 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:41:21 user nova-compute[74421]:   <source dev="/dev/sdh"/>
Oct 23 15:41:21 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:41:21 user nova-compute[74421]:   <serial>608b2f33-eb3b-4327-a82a-380357fe4a87</serial>
Oct 23 15:41:21 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:41:21 user nova-compute[74421]: </disk>
Oct 23 15:41:21 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:41:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing instance network info cache due to event network-changed-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] Acquiring lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] Acquired lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Refreshing network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:27 user nova-compute[74421]: INFO nova.compute.manager [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Terminating instance
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updated VIF entry in instance network info cache for port c99a03a6-437c-4469-9bf8-95ba5b7d6ae4. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [{"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d2f41963-cd61-4d0e-bdb4-5b3d2f085974 req-aee7c181-0308-4885-aaa5-26b852ec564d service nova] Releasing lock "refresh_cache-8e63a09b-624d-4bf2-8d8a-77225bd34a8d" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-dfb5b392-1a94-4af4-95b3-bea9d957402f req-38385faa-a77d-4eba-9efa-5d7a86505fff service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-unplugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dfb5b392-1a94-4af4-95b3-bea9d957402f req-38385faa-a77d-4eba-9efa-5d7a86505fff service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dfb5b392-1a94-4af4-95b3-bea9d957402f req-38385faa-a77d-4eba-9efa-5d7a86505fff service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dfb5b392-1a94-4af4-95b3-bea9d957402f req-38385faa-a77d-4eba-9efa-5d7a86505fff service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-dfb5b392-1a94-4af4-95b3-bea9d957402f req-38385faa-a77d-4eba-9efa-5d7a86505fff service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-unplugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-dfb5b392-1a94-4af4-95b3-bea9d957402f req-38385faa-a77d-4eba-9efa-5d7a86505fff service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-unplugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Instance destroyed successfully.
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.objects.instance [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lazy-loading 'resources' on Instance uuid 8e63a09b-624d-4bf2-8d8a-77225bd34a8d {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.compute.manager [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Terminating instance
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-474494279',display_name='tempest-TestShelveInstance-server-474494279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-474494279',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2OSiezPrLZHl4M39rxTh4qzpR3tldswq9wUaxP32WtQzURZCFBfLo5or+FYD0CFK6Nr18rS+/72Nw2QBDKxhjBDBOTPBSHsIIW1MzcCQGZvyIkgzlnKvEKOJaFxfdlw==',key_name='tempest-TestShelveInstance-1680132638',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:40:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79f5d845cfc547f69e20081a6e42c3eb',ramdisk_id='',reservation_id='r-86c22pno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1665380191',owner_user_name='tempest-TestShelveInstance-1665380191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:40:05Z,user_data=None,user_id='cac7200691824d7ca5a62ae55959832d',uuid=8e63a09b-624d-4bf2-8d8a-77225bd34a8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converting VIF {"id": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "address": "fa:16:3e:98:76:0c", "network": {"id": "d3a211d9-7153-4a29-a56f-ee45addb7057", "bridge": "br-int", "label": "tempest-TestShelveInstance-1606110251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79f5d845cfc547f69e20081a6e42c3eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99a03a6-43", "ovs_interfaceid": "c99a03a6-437c-4469-9bf8-95ba5b7d6ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_vif [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc99a03a6-43, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ee3542-7344-4357-8af2-070bdc5d1dd9) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:28 user nova-compute[74421]: INFO os_vif [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:76:0c,bridge_name='br-int',has_traffic_filtering=True,id=c99a03a6-437c-4469-9bf8-95ba5b7d6ae4,network=Network(d3a211d9-7153-4a29-a56f-ee45addb7057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99a03a6-43')
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFvUWLYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:41:28 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcfa155-2116-4dae-b1fe-df1b3e65f8cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:41:28 user nova-compute[74421]: No targets found.
Oct 23 15:41:28 user nova-compute[74421]: iSNS:
Oct 23 15:41:28 user nova-compute[74421]: No targets found.
Oct 23 15:41:28 user nova-compute[74421]: STATIC:
Oct 23 15:41:28 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:41:28 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:28 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:28 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:41:28 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:28 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:28 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:41:28 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:28 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:28 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c
Oct 23 15:41:28 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:28 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:28 user nova-compute[74421]: FIRMWARE:
Oct 23 15:41:28 user nova-compute[74421]: No targets found.
Oct 23 15:41:28 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:41:28 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:41:28 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57049f-fa10-4758-a81d-52465c7936d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[35be2302-bc37-47ee-9230-d7b0cc7c76d6]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:41:28 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:28 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:41:28 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:41:28 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:41:28 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:28 user nova-compute[74421]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c (non-flash)
Oct 23 15:41:28 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:41:28 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478786e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c'): ({'sdg'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Removing single pathed devices sdg {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d09b818-4c96-4ef9-9fc5-394abbf85b56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55122496-2a28-4ed6-aea8-180e9894f700]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Flushing IO for device /dev/sdg {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829963b-21bb-4bec-8002-6ec6be6dd94b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1c03d6-d82e-4171-85d4-368f48651d8f]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] SCSI volumes sdg have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_30fcfd2a', '/dev/disk/by-id/scsi-23164663238353337', '/dev/disk/by-id/scsi-1SCST_BIO30fcfd2a-1df2853759516cc3') {{(pid=85617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3ec16-8c51-4042-a700-28d44a4cbf71]: (4, None) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea71752-d698-4f9f-9de0-fea2b12db099]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-1df8cf85-8e9b-4505-82eb-697b96c3ba50 req-1a281d87-7f1e-4006-abbe-a02562b7e2a0 service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-vif-unplugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1df8cf85-8e9b-4505-82eb-697b96c3ba50 req-1a281d87-7f1e-4006-abbe-a02562b7e2a0 service nova] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1df8cf85-8e9b-4505-82eb-697b96c3ba50 req-1a281d87-7f1e-4006-abbe-a02562b7e2a0 service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1df8cf85-8e9b-4505-82eb-697b96c3ba50 req-1a281d87-7f1e-4006-abbe-a02562b7e2a0 service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-1df8cf85-8e9b-4505-82eb-697b96c3ba50 req-1a281d87-7f1e-4006-abbe-a02562b7e2a0 service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] No waiting events found dispatching network-vif-unplugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-1df8cf85-8e9b-4505-82eb-697b96c3ba50 req-1a281d87-7f1e-4006-abbe-a02562b7e2a0 service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-vif-unplugged-71eb1292-b5d9-4620-b019-b3cf279774aa for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec08b1-597f-497d-ba52-c3a93d3df2d8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260]
Oct 23 15:41:28 user nova-compute[74421]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c, portal: 172.16.0.220,3260] successful.
Oct 23 15:41:28 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce69ea3-e893-4552-b7d8-ab9396edad6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[024017e8-5675-4e33-9393-be362e10dc68]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] <== disconnect_volume: return (394ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Deleting instance files /opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d_del
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Deletion of /opt/stack/data/nova/instances/8e63a09b-624d-4bf2-8d8a-77225bd34a8d_del complete
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.compute.manager [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Instance destroyed successfully.
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lazy-loading 'resources' on Instance uuid 83da5c9e-eac9-4f74-9c0c-b003b475415a {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-867422842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-867422842',id=5,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f733f39c7c95492abc827bd581ca7afa',ramdisk_id='',reservation_id='r-r0q4azsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:23:45Z,user_data=None,user_id='166776dcccda43409673d99af45d4390',uuid=83da5c9e-eac9-4f74-9c0c-b003b475415a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converting VIF {"id": "71eb1292-b5d9-4620-b019-b3cf279774aa", "address": "fa:16:3e:2a:e5:f7", "network": {"id": "42a05242-b296-456e-9c02-ae0021805231", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1802853445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f733f39c7c95492abc827bd581ca7afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb1292-b5", "ovs_interfaceid": "71eb1292-b5d9-4620-b019-b3cf279774aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG os_vif [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71eb1292-b5, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fc615af-cbfc-4dc6-94b4-ecf40b9419bb) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:28 user nova-compute[74421]: INFO os_vif [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e5:f7,bridge_name='br-int',has_traffic_filtering=True,id=71eb1292-b5d9-4620-b019-b3cf279774aa,network=Network(42a05242-b296-456e-9c02-ae0021805231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb1292-b5')
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Deleting instance files /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a_del
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Deletion of /opt/stack/data/nova/instances/83da5c9e-eac9-4f74-9c0c-b003b475415a_del complete
Oct 23 15:41:28 user nova-compute[74421]: INFO nova.compute.manager [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 15:41:28 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:41:28 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:29 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Took 0.53 seconds to deallocate network for instance.
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-73de1842-3a2a-420e-9e7c-9fffff54a8d7 req-817d1315-8c22-48f9-9464-db057430ffd7 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-deleted-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:29 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Took 0.53 seconds to deallocate network for instance.
Oct 23 15:41:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing instance network info cache due to event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.network.neutron [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:29 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Deleted allocations for instance 83da5c9e-eac9-4f74-9c0c-b003b475415a
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4bce835-bf0e-49b4-9e8a-43ad55892d91 tempest-ServerBootFromVolumeStableRescueTest-2014752681 tempest-ServerBootFromVolumeStableRescueTest-2014752681-project-member] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:30 user nova-compute[74421]: INFO nova.compute.manager [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Took 0.99 seconds to detach 1 volumes for instance.
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Deleting volume: 1ce69ea3-e893-4552-b7d8-ab9396edad6c {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updated VIF entry in instance network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] Acquiring lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] No waiting events found dispatching network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:30 user nova-compute[74421]: WARNING nova.compute.manager [req-23018773-ea6a-4183-93e2-6ba746826982 req-66d4536e-0d0f-40c8-b35d-e461a2325be2 service nova] [instance: 8e63a09b-624d-4bf2-8d8a-77225bd34a8d] Received unexpected event network-vif-plugged-c99a03a6-437c-4469-9bf8-95ba5b7d6ae4 for instance with vm_state active and task_state deleting.
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] Acquiring lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] Lock "83da5c9e-eac9-4f74-9c0c-b003b475415a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] No waiting events found dispatching network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:30 user nova-compute[74421]: WARNING nova.compute.manager [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received unexpected event network-vif-plugged-71eb1292-b5d9-4620-b019-b3cf279774aa for instance with vm_state deleted and task_state None.
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-93c1d13c-4bd7-4934-919c-2508d366340c req-2c5b2519-23fc-4e12-a12a-7e0486be1e7d service nova] [instance: 83da5c9e-eac9-4f74-9c0c-b003b475415a] Received event network-vif-deleted-71eb1292-b5d9-4620-b019-b3cf279774aa {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:30 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Deleted allocations for instance 8e63a09b-624d-4bf2-8d8a-77225bd34a8d
Oct 23 15:41:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fc047b9f-ccb0-4fbc-98ed-9b7fcb5eaa3d tempest-TestShelveInstance-1665380191 tempest-TestShelveInstance-1665380191-project-member] Lock "8e63a09b-624d-4bf2-8d8a-77225bd34a8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.437s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:33 user nova-compute[74421]: INFO nova.compute.manager [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Unrescuing
Oct 23 15:41:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:41:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:41:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:41:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG nova.network.neutron [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG nova.objects.instance [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'flavor' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:34 user nova-compute[74421]: INFO nova.compute.manager [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Terminating instance
Oct 23 15:41:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-d8990867-f517-48f1-8eb6-33f0dadc1591 req-229731f9-5f1d-4672-b88b-dbb94c9a070d service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d8990867-f517-48f1-8eb6-33f0dadc1591 req-229731f9-5f1d-4672-b88b-dbb94c9a070d service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d8990867-f517-48f1-8eb6-33f0dadc1591 req-229731f9-5f1d-4672-b88b-dbb94c9a070d service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d8990867-f517-48f1-8eb6-33f0dadc1591 req-229731f9-5f1d-4672-b88b-dbb94c9a070d service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-d8990867-f517-48f1-8eb6-33f0dadc1591 req-229731f9-5f1d-4672-b88b-dbb94c9a070d service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:34 user nova-compute[74421]: WARNING nova.compute.manager [req-d8990867-f517-48f1-8eb6-33f0dadc1591 req-229731f9-5f1d-4672-b88b-dbb94c9a070d service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:41:34 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance destroyed successfully.
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:35 user nova-compute[74421]: INFO nova.compute.manager [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Shelving
Oct 23 15:41:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-b711cda8-0fe8-4088-83cc-4a096428c9fb req-6b6e083d-a3bb-4349-9931-36ed290f8926 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b711cda8-0fe8-4088-83cc-4a096428c9fb req-6b6e083d-a3bb-4349-9931-36ed290f8926 service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b711cda8-0fe8-4088-83cc-4a096428c9fb req-6b6e083d-a3bb-4349-9931-36ed290f8926 service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b711cda8-0fe8-4088-83cc-4a096428c9fb req-6b6e083d-a3bb-4349-9931-36ed290f8926 service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-b711cda8-0fe8-4088-83cc-4a096428c9fb req-6b6e083d-a3bb-4349-9931-36ed290f8926 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:35 user nova-compute[74421]: WARNING nova.compute.manager [req-b711cda8-0fe8-4088-83cc-4a096428c9fb req-6b6e083d-a3bb-4349-9931-36ed290f8926 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state active and task_state shelving.
Oct 23 15:41:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Instance destroyed successfully.
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.objects.instance [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lazy-loading 'resources' on Instance uuid 797f85e1-87ce-4295-8e14-19fd0919f2a0 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance destroyed successfully.
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-960484498',display_name='tempest-ServerActionsTestOtherA-server-960484498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-960484498',id=4,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFyJKO5wg/gQaZ/lQe7Uq3v07nwXkNIC4UytLFs5tVjwbifyv5gRXtzyPrl4W5rX5wymYjC/cEEGc9gBQBKv5Imq116ccBhj8WvMwzArVjVp3GtGBCSORpka64jkgm1Q==',key_name='tempest-keypair-284923298',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0053dc54a1e44f18966d687a2bb42e4',ramdisk_id='',reservation_id='r-24pj4n4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-369604222',owner_user_name='tempest-ServerActionsTestOtherA-369604222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182146bec4cf473ab9e025bca5a74371',uuid=797f85e1-87ce-4295-8e14-19fd0919f2a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converting VIF {"id": "4601ea46-2069-471a-8de8-0547b9aea8c9", "address": "fa:16:3e:c7:63:28", "network": {"id": "7486fed2-d8a9-41ff-bebf-19e9b84113ce", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-625546140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0053dc54a1e44f18966d687a2bb42e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4601ea46-20", "ovs_interfaceid": "4601ea46-2069-471a-8de8-0547b9aea8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG os_vif [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4601ea46-20, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=215b0a8c-691c-43ea-a497-44444cdc22f4) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Beginning cold snapshot process
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:36 user nova-compute[74421]: INFO os_vif [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:63:28,bridge_name='br-int',has_traffic_filtering=True,id=4601ea46-2069-471a-8de8-0547b9aea8c9,network=Network(7486fed2-d8a9-41ff-bebf-19e9b84113ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4601ea46-20')
Oct 23 15:41:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Deleting instance files /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0_del
Oct 23 15:41:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Deletion of /opt/stack/data/nova/instances/797f85e1-87ce-4295-8e14-19fd0919f2a0_del complete
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:36 user nova-compute[74421]: WARNING nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-vif-unplugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] No waiting events found dispatching network-vif-unplugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-vif-unplugged-4601ea46-2069-471a-8de8-0547b9aea8c9 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Acquiring lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] No waiting events found dispatching network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:36 user nova-compute[74421]: WARNING nova.compute.manager [req-6778b446-2f42-4070-b7fd-f03f21f7c455 req-024169c2-3400-46cc-8145-82a8e9781ba1 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received unexpected event network-vif-plugged-4601ea46-2069-471a-8de8-0547b9aea8c9 for instance with vm_state active and task_state deleting.
Oct 23 15:41:36 user nova-compute[74421]: INFO nova.compute.manager [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Took 2.23 seconds to destroy the instance on the hypervisor.
Oct 23 15:41:36 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:41:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk /opt/stack/data/nova/instances/snapshots/tmpcn5lbzn6/c5fdd54ea0864cfab92f1965051ff558 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:37 user nova-compute[74421]: WARNING nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:37 user nova-compute[74421]: WARNING nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:37 user nova-compute[74421]: WARNING nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:37 user nova-compute[74421]: WARNING nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:37 user nova-compute[74421]: WARNING nova.compute.manager [req-b87eb93b-3992-4d88-8a35-931f647d5aad req-d90ee227-8c0f-406e-9f0f-ea34b216ef4f service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk /opt/stack/data/nova/instances/snapshots/tmpcn5lbzn6/c5fdd54ea0864cfab92f1965051ff558" returned: 0 in 0.690s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:37 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Snapshot extracted, beginning image upload
Oct 23 15:41:37 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:37 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Took 1.01 seconds to deallocate network for instance.
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:38 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Deleted allocations for instance 797f85e1-87ce-4295-8e14-19fd0919f2a0
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-43b9bbc5-3abe-4102-af73-bb41f318ea63 tempest-ServerActionsTestOtherA-369604222 tempest-ServerActionsTestOtherA-369604222-project-member] Lock "797f85e1-87ce-4295-8e14-19fd0919f2a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.845s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 797f85e1-87ce-4295-8e14-19fd0919f2a0] Received event network-vif-deleted-4601ea46-2069-471a-8de8-0547b9aea8c9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:38 user nova-compute[74421]: WARNING nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:38 user nova-compute[74421]: WARNING nova.compute.manager [req-a0b71536-8cf9-44cc-bf6e-89e09c1676b7 req-c7f0bfdf-b213-4c8f-82d1-a7d84875d3c3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 15:41:39 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 is timed out.
Oct 23 15:41:39 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Successfully detached device vdb from instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 from the live domain config.
Oct 23 15:41:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKYncWis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:41:39 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b766b909-40fd-44e4-9020-e0a2de8e63c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:41:39 user nova-compute[74421]: No targets found.
Oct 23 15:41:39 user nova-compute[74421]: iSNS:
Oct 23 15:41:39 user nova-compute[74421]: No targets found.
Oct 23 15:41:39 user nova-compute[74421]: STATIC:
Oct 23 15:41:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:41:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:41:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:39 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e
Oct 23 15:41:39 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:39 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:39 user nova-compute[74421]: FIRMWARE:
Oct 23 15:41:39 user nova-compute[74421]: No targets found.
Oct 23 15:41:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:41:39 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:41:39 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbf9418-a60b-4dbe-84e4-5c17a971e8e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d145f0bf-f2f8-4fdd-9f1c-ce2ef8d2ffbe]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:41:39 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:39 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:41:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e (non-flash)
Oct 23 15:41:39 user nova-compute[74421]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:39 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:41:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478306950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e'): ({'sdf'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Removing single pathed devices sdf {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075687f-88dc-45eb-9c5a-20cf73fa9be9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b343426-337c-437e-a9bc-7f69d890e3e7]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Flushing IO for device /dev/sdf {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8609ef04-50e4-4ad4-ab79-40a72cb4764b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60927a5-5f70-40c2-bbe9-d365bc77110f]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] SCSI volumes sdf have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60de57f-f6f5-4353-a263-650f8244bde2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e29bc-9c5a-4181-9249-ee6c29924e85]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260]
Oct 23 15:41:39 user nova-compute[74421]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e, portal: 172.16.0.220,3260] successful.
Oct 23 15:41:39 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc0772-bba2-4065-bf30-257fee16082e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c19c6dc-ca29-4b3d-948a-ec5187a74580]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] <== disconnect_volume: return (330ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:41:39 user nova-compute[74421]: DEBUG nova.compute.manager [None req-395172d5-2577-4890-a3f4-542964c06e52 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:41:40 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'flavor' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a7defe7c-7f4a-4a23-b830-52bca2d64986 tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.917s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:40 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Snapshot image upload complete
Oct 23 15:41:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:41:41 user nova-compute[74421]: INFO nova.compute.manager [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Shelve offloading
Oct 23 15:41:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance destroyed successfully.
Oct 23 15:41:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:41:41 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e is timed out.
Oct 23 15:41:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully detached device vdb from instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e from the live domain config.
Oct 23 15:41:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLhYSeXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:41:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[342a584f-319a-44a6-9b3a-eb79310298d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:41:41 user nova-compute[74421]: No targets found.
Oct 23 15:41:41 user nova-compute[74421]: iSNS:
Oct 23 15:41:41 user nova-compute[74421]: No targets found.
Oct 23 15:41:41 user nova-compute[74421]: STATIC:
Oct 23 15:41:41 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:41:41 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:41 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:41 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87
Oct 23 15:41:41 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:41 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:41 user nova-compute[74421]: FIRMWARE:
Oct 23 15:41:41 user nova-compute[74421]: No targets found.
Oct 23 15:41:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:41:41 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:41:41 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab144f-9eb1-4f80-9508-c57bf9cd5a1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b3264-3a43-41d3-8fda-904062d8e087]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:41 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:41:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:41 user nova-compute[74421]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 (non-flash)
Oct 23 15:41:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24803cfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87'): ({'sdh'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Removing single pathed devices sdh {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2f8ba-0afd-48c9-9d0b-942932863083]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[158bc949-00be-488f-863b-d74a0f2d60ce]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Flushing IO for device /dev/sdh {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c3c4f-3f06-411c-9db6-91ccdf5c94d9]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[39365750-f62b-442a-b60e-2397af667f36]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] SCSI volumes sdh have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[37354a1e-45ad-45a6-b161-fa77b708f80e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b3f3a-a45e-459c-9ec0-a2a75aa08f13]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260]
Oct 23 15:41:41 user nova-compute[74421]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87, portal: 172.16.0.220,3260] successful.
Oct 23 15:41:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f87ddf3-3130-4b30-8e64-d84d45f828f6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== disconnect_volume: return (332ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:41:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:41:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance destroyed successfully.
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'resources' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-708899226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-708899226',id=37,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs2SJ3PWp8n1rZk+PqNlU/0TBjdJzfsVR5RXje4n8pWqSXgt2G70Zu90AZaj+CcqTUPLncgCtsTDJIvmstQIS9h3mCXuIIH5u65ApT9s1vhj70zZB2hFiY7VXD5pu3vhg==',key_name='tempest-keypair-1026354056',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-icsh0y35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member',shelved_at='2023-10-23T15:41:40.956625',shelved_host='user',shelved_image_id='a995208e-856d-4c80-ba65-9e25114c1fb6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG os_vif [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43a0cdb2-cb, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ae3ffa0-4df4-475d-9461-dc1d0f25a5fd) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:42 user nova-compute[74421]: INFO os_vif [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb')
Oct 23 15:41:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Deleting instance files /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee_del
Oct 23 15:41:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Deletion of /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee_del complete
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing instance network info cache due to event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.network.neutron [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:41:42 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Deleted allocations for instance 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.objects.base [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee> lazy-loaded attributes: resources,numa_topology {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.network.neutron [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updated VIF entry in instance network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.network.neutron [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6a6c48f2-a29b-4a21-9d57-da9dd499d7c5 req-931e470b-bf45-447e-8d7d-b826d5e2ae07 service nova] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'flavor' on Instance uuid 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-647958dc-b2c7-4992-99cb-4adb4249699b tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.738s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:42 user nova-compute[74421]: INFO nova.compute.manager [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Terminating instance
Oct 23 15:41:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b20832c8-b4f3-4f8b-b30f-3f718849b178 tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.839s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Instance destroyed successfully.
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'resources' on Instance uuid 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1263149479',display_name='tempest-VolumesSnapshotTestJSON-instance-1263149479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1263149479',id=36,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr6nDOWx8Abwi/IW5zvQ9QU2hb3zm4OdcoYmgD6nHgLI+Hal7ivs4QUGgC8+a+MozsLnbKaY8awb9r55+INvQelEETSeDVDA9hHXYss9BXY424TQhLYwSCepHVm6LVzXA==',key_name='tempest-keypair-1455470655',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e4434fbc6814bbb9fe2c48ed84f4a38',ramdisk_id='',reservation_id='r-ssgoxpl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-461344925',owner_user_name='tempest-VolumesSnapshotTestJSON-461344925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f04beb9793444f0a92dcad598ce6533',uuid=794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converting VIF {"id": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "address": "fa:16:3e:d4:ad:f9", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d29cd30-7b", "ovs_interfaceid": "6d29cd30-7b4c-4af3-a083-be2db7680c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_vif [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d29cd30-7b, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9f795fe-6a46-4666-99a8-6dc50764ae6e) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:43 user nova-compute[74421]: INFO os_vif [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ad:f9,bridge_name='br-int',has_traffic_filtering=True,id=6d29cd30-7b4c-4af3-a083-be2db7680c00,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d29cd30-7b')
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLhYSeXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:41:43 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445ca6f-4c84-417a-9592-ed85f383b816]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:41:43 user nova-compute[74421]: No targets found.
Oct 23 15:41:43 user nova-compute[74421]: iSNS:
Oct 23 15:41:43 user nova-compute[74421]: No targets found.
Oct 23 15:41:43 user nova-compute[74421]: STATIC:
Oct 23 15:41:43 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:41:43 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:41:43 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:41:43 user nova-compute[74421]: FIRMWARE:
Oct 23 15:41:43 user nova-compute[74421]: No targets found.
Oct 23 15:41:43 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:41:43 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:41:43 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:608b2f33-eb3b-4327-a82a-380357fe4a87', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6241d5-1365-467c-af91-d7e5c2953b0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eb3116-d08a-4d95-bbec-96de297d22d0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:43 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:41:43 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247823be20>, {}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Disconnecting from: [] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== disconnect_volume: return (64ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:41:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Deleting instance files /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e_del
Oct 23 15:41:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Deletion of /opt/stack/data/nova/instances/794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e_del complete
Oct 23 15:41:43 user nova-compute[74421]: INFO nova.compute.manager [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 15:41:43 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:41:43 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-vif-unplugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] No waiting events found dispatching network-vif-unplugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-vif-unplugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] Acquiring lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] No waiting events found dispatching network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:44 user nova-compute[74421]: WARNING nova.compute.manager [req-086c1d4e-d129-4965-8b37-c44f493c01eb req-ba660823-598e-46f3-b1a0-9c32b0da0870 service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received unexpected event network-vif-plugged-6d29cd30-7b4c-4af3-a083-be2db7680c00 for instance with vm_state active and task_state deleting.
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:44 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Took 0.75 seconds to deallocate network for instance.
Oct 23 15:41:44 user nova-compute[74421]: WARNING nova.volume.cinder [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Attachment 7bb58b85-7dba-4c99-a994-e5d6648f262d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7bb58b85-7dba-4c99-a994-e5d6648f262d. (HTTP 404) (Request-ID: req-f6df7824-7b04-4ff0-a485-877180f01fd3)
Oct 23 15:41:44 user nova-compute[74421]: INFO nova.compute.manager [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Took 0.03 seconds to detach 1 volumes for instance.
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:45 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Deleted allocations for instance 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e
Oct 23 15:41:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d125c996-016e-47ce-aaed-d347c9efc5b8 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:45 user nova-compute[74421]: INFO nova.compute.manager [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Terminating instance
Oct 23 15:41:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Instance destroyed successfully.
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lazy-loading 'resources' on Instance uuid 5c0a8a34-9471-4832-8652-cfa129c8114f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:39:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1831100185',display_name='tempest-VolumesNegativeTest-instance-1831100185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1831100185',id=38,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cca5332171df4d37a5d29e9f39da22d8',ramdisk_id='',reservation_id='r-e068mtk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-771010811',owner_user_name='tempest-VolumesNegativeTest-771010811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:40:03Z,user_data=None,user_id='53583412174b40f880bac0c01314b070',uuid=5c0a8a34-9471-4832-8652-cfa129c8114f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Converting VIF {"id": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "address": "fa:16:3e:d8:a6:07", "network": {"id": "63c9e019-b6fe-440e-9d68-4f1008c3916a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df2b2b1c5c2a40d29cd895d80c0344e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ed8b39-26", "ovs_interfaceid": "e6ed8b39-264c-4474-b1b6-1c43cdd5bf92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG os_vif [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6ed8b39-26, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e80eed22-55c3-4148-9ecc-b04711d4971e) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:41:46 user nova-compute[74421]: INFO os_vif [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:07,bridge_name='br-int',has_traffic_filtering=True,id=e6ed8b39-264c-4474-b1b6-1c43cdd5bf92,network=Network(63c9e019-b6fe-440e-9d68-4f1008c3916a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ed8b39-26')
Oct 23 15:41:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Deleting instance files /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f_del
Oct 23 15:41:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Deletion of /opt/stack/data/nova/instances/5c0a8a34-9471-4832-8652-cfa129c8114f_del complete
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 794af6cc-1fd0-4cf2-90d8-6a2b2663bc2e] Received event network-vif-deleted-6d29cd30-7b4c-4af3-a083-be2db7680c00 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-vif-unplugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] No waiting events found dispatching network-vif-unplugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-vif-unplugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] Acquiring lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] No waiting events found dispatching network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:41:46 user nova-compute[74421]: WARNING nova.compute.manager [req-09691626-91e5-4eab-aceb-2594d8431655 req-fc4eb367-e12e-4b64-9792-ecac3886647d service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received unexpected event network-vif-plugged-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 for instance with vm_state active and task_state deleting.
Oct 23 15:41:46 user nova-compute[74421]: INFO nova.compute.manager [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:46 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Took 0.39 seconds to deallocate network for instance.
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:46 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:47 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:47 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:47 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Deleted allocations for instance 5c0a8a34-9471-4832-8652-cfa129c8114f
Oct 23 15:41:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [{"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:41:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:41:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:41:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ad65a662-cddf-4dc4-943c-f25865d4127f tempest-VolumesNegativeTest-771010811 tempest-VolumesNegativeTest-771010811-project-member] Lock "5c0a8a34-9471-4832-8652-cfa129c8114f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-717eeba9-c9a2-495b-8b3d-cfd76a65074d req-4a2f7db0-826c-4bdd-a12c-037a0491390a service nova] [instance: 5c0a8a34-9471-4832-8652-cfa129c8114f] Received event network-vif-deleted-e6ed8b39-264c-4474-b1b6-1c43cdd5bf92 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:41:48 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:41:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:41:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:41:51 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8181MB free_disk=25.010330200195312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:41:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:41:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:41:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:41:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:41:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:09 user nova-compute[74421]: INFO nova.compute.manager [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Terminating instance
Oct 23 15:42:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-695ff4c8-d80f-49c5-a2c5-a0fc1067a918 req-ea2ed7cd-8f4c-47d2-ab83-7ee784a1d6d1 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-695ff4c8-d80f-49c5-a2c5-a0fc1067a918 req-ea2ed7cd-8f4c-47d2-ab83-7ee784a1d6d1 service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-695ff4c8-d80f-49c5-a2c5-a0fc1067a918 req-ea2ed7cd-8f4c-47d2-ab83-7ee784a1d6d1 service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-695ff4c8-d80f-49c5-a2c5-a0fc1067a918 req-ea2ed7cd-8f4c-47d2-ab83-7ee784a1d6d1 service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-695ff4c8-d80f-49c5-a2c5-a0fc1067a918 req-ea2ed7cd-8f4c-47d2-ab83-7ee784a1d6d1 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:42:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-695ff4c8-d80f-49c5-a2c5-a0fc1067a918 req-ea2ed7cd-8f4c-47d2-ab83-7ee784a1d6d1 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-unplugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:42:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Instance destroyed successfully.
Oct 23 15:42:10 user nova-compute[74421]: DEBUG nova.objects.instance [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lazy-loading 'resources' on Instance uuid 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-421215235',display_name='tempest-ServerStableDeviceRescueTest-server-421215235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-421215235',id=32,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBvo0kVlIhhyl67IvxCbw2l4gBzHopt6ssxdLzHTEiG+m4TghLNIFCoYGZEPBE2ROJ4/vgCRLw5ObBwv1WqcT2PAO0jtPBiAyYOJIvlFS999aFAy4jfuCRX5i50Vi9tqg==',key_name='tempest-keypair-1702398332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:39:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c0d0b7398cb46eb8679e805d97f885d',ramdisk_id='',reservation_id='r-he732kxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1906331641',owner_user_name='tempest-ServerStableDeviceRescueTest-1906331641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dd14495e7f4cf8b8749576587dcd0f',uuid=8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converting VIF {"id": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "address": "fa:16:3e:03:60:32", "network": {"id": "c439c697-607d-4886-a0e3-dd695385e076", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1533941021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c0d0b7398cb46eb8679e805d97f885d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3732d23a-ce", "ovs_interfaceid": "3732d23a-cecb-4ede-b572-d105a2c3dda3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG os_vif [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3732d23a-ce, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=449d35af-08ff-4950-a05e-0f070eaec486) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:10 user nova-compute[74421]: INFO os_vif [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:60:32,bridge_name='br-int',has_traffic_filtering=True,id=3732d23a-cecb-4ede-b572-d105a2c3dda3,network=Network(c439c697-607d-4886-a0e3-dd695385e076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3732d23a-ce')
Oct 23 15:42:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Deleting instance files /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3_del
Oct 23 15:42:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Deletion of /opt/stack/data/nova/instances/8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3_del complete
Oct 23 15:42:10 user nova-compute[74421]: INFO nova.compute.manager [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 15:42:10 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:42:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:11 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:42:11 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Took 0.71 seconds to deallocate network for instance.
Oct 23 15:42:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-d37d4bb2-fb4c-4adb-ab00-3a819cd0573e req-2caf4800-9c69-48ac-8bff-12444991a153 service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-deleted-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:42:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:11 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:42:11 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:42:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:11 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Deleted allocations for instance 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3
Oct 23 15:42:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-549cce45-b4c9-4415-8766-41d03280664b tempest-ServerStableDeviceRescueTest-1906331641 tempest-ServerStableDeviceRescueTest-1906331641-project-member] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.025s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f394141-21ca-4e51-bf1f-b50c6ff61c58 req-e5870b39-0c61-45e6-b51f-097e613c9a6c service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:42:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f394141-21ca-4e51-bf1f-b50c6ff61c58 req-e5870b39-0c61-45e6-b51f-097e613c9a6c service nova] Acquiring lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f394141-21ca-4e51-bf1f-b50c6ff61c58 req-e5870b39-0c61-45e6-b51f-097e613c9a6c service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f394141-21ca-4e51-bf1f-b50c6ff61c58 req-e5870b39-0c61-45e6-b51f-097e613c9a6c service nova] Lock "8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f394141-21ca-4e51-bf1f-b50c6ff61c58 req-e5870b39-0c61-45e6-b51f-097e613c9a6c service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] No waiting events found dispatching network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:42:12 user nova-compute[74421]: WARNING nova.compute.manager [req-8f394141-21ca-4e51-bf1f-b50c6ff61c58 req-e5870b39-0c61-45e6-b51f-097e613c9a6c service nova] [instance: 8bcb7b51-300a-4f4c-b3e8-f7dab40c88f3] Received unexpected event network-vif-plugged-3732d23a-cecb-4ede-b572-d105a2c3dda3 for instance with vm_state deleted and task_state None.
Oct 23 15:42:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:42:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:42:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:42:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:42:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:42:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:42:44 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:42:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:42:47 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:42:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:42:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:42:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:42:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:42:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.12234878540039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:42:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:54 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:54 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:54 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:42:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:57 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:42:57 user nova-compute[74421]: INFO nova.compute.claims [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Claim successful on node user
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:42:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.policy [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f04beb9793444f0a92dcad598ce6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4434fbc6814bbb9fe2c48ed84f4a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:42:58 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Creating image(s)
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "/opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "/opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "/opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk 1073741824" returned: 0 in 0.082s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.network.neutron [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Successfully created port: c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Cannot resize image /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Ensure instance console log exists: /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.network.neutron [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Successfully updated port: c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquired lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.network.neutron [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:42:59 user nova-compute[74421]: DEBUG nova.network.neutron [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-changed-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.compute.manager [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Refreshing instance network info cache due to event network-changed-c4315ece-59ee-4bc5-af08-8490573ba593. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] Acquiring lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.neutron [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating instance_info_cache with network_info: [{"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Releasing lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Instance network_info: |[{"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] Acquired lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Refreshing network info cache for port c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Start _get_guest_xml network_info=[{"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:43:00 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:43:00 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1605006937',display_name='tempest-VolumesSnapshotTestJSON-instance-1605006937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1605006937',id=39,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRE1NHM1wEcDUogm+UQMmqnrhrgjre2VsiCR6BLqvESqum1x50Cy7ibkFSmB3gfcxHYaDGtKoaq39LhbNe08O/MgWiq77LpfvU7X/Yl/kNp5ccZytKxCHmvMSAutay9rg==',key_name='tempest-keypair-398532734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4434fbc6814bbb9fe2c48ed84f4a38',ramdisk_id='',reservation_id='r-q67bohrq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-461344925',owner_user_name='tempest-VolumesSnapshotTestJSON-461344925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f04beb9793444f0a92dcad598ce6533',uuid=d937f218-8349-4e47-a8da-5cea5d6d70a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converting VIF {"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.objects.instance [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'pci_devices' on Instance uuid d937f218-8349-4e47-a8da-5cea5d6d70a5 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:43:00 user nova-compute[74421]:   <uuid>d937f218-8349-4e47-a8da-5cea5d6d70a5</uuid>
Oct 23 15:43:00 user nova-compute[74421]:   <name>instance-00000027</name>
Oct 23 15:43:00 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:43:00 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:43:00 user nova-compute[74421]:   <metadata>
Oct 23 15:43:00 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:43:00 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:43:00 user nova-compute[74421]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1605006937</nova:name>
Oct 23 15:43:00 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:43:00</nova:creationTime>
Oct 23 15:43:00 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:43:00 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:43:00 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:43:00 user nova-compute[74421]:       <nova:owner>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:user uuid="2f04beb9793444f0a92dcad598ce6533">tempest-VolumesSnapshotTestJSON-461344925-project-member</nova:user>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:project uuid="2e4434fbc6814bbb9fe2c48ed84f4a38">tempest-VolumesSnapshotTestJSON-461344925</nova:project>
Oct 23 15:43:00 user nova-compute[74421]:       </nova:owner>
Oct 23 15:43:00 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:43:00 user nova-compute[74421]:       <nova:ports>
Oct 23 15:43:00 user nova-compute[74421]:         <nova:port uuid="c4315ece-59ee-4bc5-af08-8490573ba593">
Oct 23 15:43:00 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:43:00 user nova-compute[74421]:         </nova:port>
Oct 23 15:43:00 user nova-compute[74421]:       </nova:ports>
Oct 23 15:43:00 user nova-compute[74421]:     </nova:instance>
Oct 23 15:43:00 user nova-compute[74421]:   </metadata>
Oct 23 15:43:00 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:43:00 user nova-compute[74421]:     <system>
Oct 23 15:43:00 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:43:00 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:43:00 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:43:00 user nova-compute[74421]:       <entry name="serial">d937f218-8349-4e47-a8da-5cea5d6d70a5</entry>
Oct 23 15:43:00 user nova-compute[74421]:       <entry name="uuid">d937f218-8349-4e47-a8da-5cea5d6d70a5</entry>
Oct 23 15:43:00 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:43:00 user nova-compute[74421]:     </system>
Oct 23 15:43:00 user nova-compute[74421]:   </sysinfo>
Oct 23 15:43:00 user nova-compute[74421]:   <os>
Oct 23 15:43:00 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:43:00 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:43:00 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:43:00 user nova-compute[74421]:   </os>
Oct 23 15:43:00 user nova-compute[74421]:   <features>
Oct 23 15:43:00 user nova-compute[74421]:     <acpi/>
Oct 23 15:43:00 user nova-compute[74421]:     <apic/>
Oct 23 15:43:00 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:43:00 user nova-compute[74421]:   </features>
Oct 23 15:43:00 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:43:00 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:43:00 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:43:00 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:43:00 user nova-compute[74421]:   </clock>
Oct 23 15:43:00 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:43:00 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:43:00 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:43:00 user nova-compute[74421]:   </cpu>
Oct 23 15:43:00 user nova-compute[74421]:   <devices>
Oct 23 15:43:00 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:43:00 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:43:00 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk"/>
Oct 23 15:43:00 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:43:00 user nova-compute[74421]:     </disk>
Oct 23 15:43:00 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:43:00 user nova-compute[74421]:       <mac address="fa:16:3e:f9:8b:c7"/>
Oct 23 15:43:00 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:43:00 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:43:00 user nova-compute[74421]:       <target dev="tapc4315ece-59"/>
Oct 23 15:43:00 user nova-compute[74421]:     </interface>
Oct 23 15:43:00 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:43:00 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/console.log" append="off"/>
Oct 23 15:43:00 user nova-compute[74421]:     </serial>
Oct 23 15:43:00 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:43:00 user nova-compute[74421]:     <video>
Oct 23 15:43:00 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:43:00 user nova-compute[74421]:     </video>
Oct 23 15:43:00 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:43:00 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:43:00 user nova-compute[74421]:     </rng>
Oct 23 15:43:00 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:43:00 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:43:00 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:43:00 user nova-compute[74421]:     </memballoon>
Oct 23 15:43:00 user nova-compute[74421]:   </devices>
Oct 23 15:43:00 user nova-compute[74421]: </domain>
Oct 23 15:43:00 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1605006937',display_name='tempest-VolumesSnapshotTestJSON-instance-1605006937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1605006937',id=39,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRE1NHM1wEcDUogm+UQMmqnrhrgjre2VsiCR6BLqvESqum1x50Cy7ibkFSmB3gfcxHYaDGtKoaq39LhbNe08O/MgWiq77LpfvU7X/Yl/kNp5ccZytKxCHmvMSAutay9rg==',key_name='tempest-keypair-398532734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4434fbc6814bbb9fe2c48ed84f4a38',ramdisk_id='',reservation_id='r-q67bohrq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-461344925',owner_user_name='tempest-VolumesSnapshotTestJSON-461344925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f04beb9793444f0a92dcad598ce6533',uuid=d937f218-8349-4e47-a8da-5cea5d6d70a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converting VIF {"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG os_vif [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f29d57fe-482f-53ec-be47-fc1e8ab7fda8', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4315ece-59, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4315ece-59, col_values=(('qos', UUID('f3632166-09ac-4a7d-b01a-f2cf4ecc6869')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4315ece-59, col_values=(('external_ids', {'iface-id': 'c4315ece-59ee-4bc5-af08-8490573ba593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:8b:c7', 'vm-uuid': 'd937f218-8349-4e47-a8da-5cea5d6d70a5'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:00 user nova-compute[74421]: INFO os_vif [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59')
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No VIF found with MAC fa:16:3e:f9:8b:c7, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updated VIF entry in instance network info cache for port c4315ece-59ee-4bc5-af08-8490573ba593. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG nova.network.neutron [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating instance_info_cache with network_info: [{"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0f42c84f-92a8-4161-965f-630ad9a8a5af req-47a2fdc8-e973-4fbb-8b00-36169caad834 service nova] Releasing lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-8345dcd2-2535-476e-8a75-88c276e0592e req-3b4585d9-d058-46f7-8edf-4e10b3f30f57 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8345dcd2-2535-476e-8a75-88c276e0592e req-3b4585d9-d058-46f7-8edf-4e10b3f30f57 service nova] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8345dcd2-2535-476e-8a75-88c276e0592e req-3b4585d9-d058-46f7-8edf-4e10b3f30f57 service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8345dcd2-2535-476e-8a75-88c276e0592e req-3b4585d9-d058-46f7-8edf-4e10b3f30f57 service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-8345dcd2-2535-476e-8a75-88c276e0592e req-3b4585d9-d058-46f7-8edf-4e10b3f30f57 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] No waiting events found dispatching network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:43:02 user nova-compute[74421]: WARNING nova.compute.manager [req-8345dcd2-2535-476e-8a75-88c276e0592e req-3b4585d9-d058-46f7-8edf-4e10b3f30f57 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received unexpected event network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 for instance with vm_state building and task_state spawning.
Oct 23 15:43:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-753a4629-e941-4551-adec-1595eb86a1cf req-fb22510b-b03b-4f83-b5dc-26efc70a6e2b service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-753a4629-e941-4551-adec-1595eb86a1cf req-fb22510b-b03b-4f83-b5dc-26efc70a6e2b service nova] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-753a4629-e941-4551-adec-1595eb86a1cf req-fb22510b-b03b-4f83-b5dc-26efc70a6e2b service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-753a4629-e941-4551-adec-1595eb86a1cf req-fb22510b-b03b-4f83-b5dc-26efc70a6e2b service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-753a4629-e941-4551-adec-1595eb86a1cf req-fb22510b-b03b-4f83-b5dc-26efc70a6e2b service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] No waiting events found dispatching network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:43:04 user nova-compute[74421]: WARNING nova.compute.manager [req-753a4629-e941-4551-adec-1595eb86a1cf req-fb22510b-b03b-4f83-b5dc-26efc70a6e2b service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received unexpected event network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 for instance with vm_state building and task_state spawning.
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:43:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Instance spawned successfully.
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:43:04 user nova-compute[74421]: INFO nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Took 5.96 seconds to spawn the instance on the hypervisor.
Oct 23 15:43:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:43:04 user nova-compute[74421]: INFO nova.compute.manager [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Took 6.91 seconds to build instance.
Oct 23 15:43:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-18f6dff0-71ff-4a12-825c-c0143a88f396 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.032s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:43:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:43:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:43:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:43:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:43:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:43:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing instance network info cache due to event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:43:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:43:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:43:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updated VIF entry in instance network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f751ffa-e460-4fc5-83fc-1d91232e075a req-f0303807-cddb-4343-980b-53fd7b2ed39b service nova] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:25 user nova-compute[74421]: INFO nova.compute.manager [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Detaching volume 74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:43:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:25 user nova-compute[74421]: INFO nova.virt.block_device [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Attempting to driver detach volume 74c84120-4b83-4da3-a9cd-4b48057dc051 from mountpoint /dev/vdb
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Attempting to detach device vdb from instance 146c13ae-a37f-406d-8dc6-13f0413efdae from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:43:25 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:43:25 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:43:25 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:43:25 user nova-compute[74421]:   <serial>74c84120-4b83-4da3-a9cd-4b48057dc051</serial>
Oct 23 15:43:25 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:43:25 user nova-compute[74421]: </disk>
Oct 23 15:43:25 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:43:25 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully detached device vdb from instance 146c13ae-a37f-406d-8dc6-13f0413efdae from the persistent domain config.
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 146c13ae-a37f-406d-8dc6-13f0413efdae from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:43:25 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:43:25 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:43:25 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:43:25 user nova-compute[74421]:   <serial>74c84120-4b83-4da3-a9cd-4b48057dc051</serial>
Oct 23 15:43:25 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:43:25 user nova-compute[74421]: </disk>
Oct 23 15:43:25 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:43:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing instance network info cache due to event network-changed-01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:43:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] Acquiring lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:43:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] Acquired lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:43:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Refreshing network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:43:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updated VIF entry in instance network info cache for port 01e85c82-ce95-4efc-b892-7195d64b52c8. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:43:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [{"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-96d2b3fb-e5c2-4272-b523-c3325f7e9703 req-1952c537-b1ad-4c98-9c5a-22ff544b02d2 service nova] Releasing lock "refresh_cache-146c13ae-a37f-406d-8dc6-13f0413efdae" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:28 user nova-compute[74421]: INFO nova.compute.manager [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Unshelving
Oct 23 15:43:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:28 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'pci_requests' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:28 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:28 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:43:28 user nova-compute[74421]: INFO nova.compute.claims [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Claim successful on node user
Oct 23 15:43:29 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:43:29 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:43:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:29 user nova-compute[74421]: INFO nova.network.neutron [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating port 43a0cdb2-cb72-44a7-b132-67a37512c70a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 15:43:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:43:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:43:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing instance network info cache due to event network-changed-43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] Acquiring lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:43:30 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Creating image(s)
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] Acquired lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Refreshing network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG nova.objects.base [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "59c864ce83212e842c7774236dd3b27ee150a5de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "59c864ce83212e842c7774236dd3b27ee150a5de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG nova.virt.images [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] a995208e-856d-4c80-ba65-9e25114c1fb6 was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.part /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updated VIF entry in instance network info cache for port 43a0cdb2-cb72-44a7-b132-67a37512c70a. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3befd716-8f92-4e86-b412-ab417c0ee9f5 req-a52aaefd-1b0f-45c4-a3ad-cc37d307fd21 service nova] Releasing lock "refresh_cache-6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.part /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.converted" returned: 0 in 0.528s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "59c864ce83212e842c7774236dd3b27ee150a5de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.145s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de --force-share --output=json" returned: 0 in 0.192s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "59c864ce83212e842c7774236dd3b27ee150a5de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "59c864ce83212e842c7774236dd3b27ee150a5de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de --force-share --output=json" returned: 0 in 0.196s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de,backing_fmt=raw /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de,backing_fmt=raw /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk 1073741824" returned: 0 in 0.055s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "59c864ce83212e842c7774236dd3b27ee150a5de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'migration_context' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG nova.objects.base [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:43:33 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Rebasing disk image.
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.225s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee -F raw /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee -F raw /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk" returned: 0 in 3.169s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Ensure instance console log exists: /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Start _get_guest_xml network_info=[{"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='69dd29f2c70ea505a14741accc5dbb08',container_format='bare',created_at=2023-10-23T15:41:35Z,direct_url=<?>,disk_format='qcow2',id=a995208e-856d-4c80-ba65-9e25114c1fb6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-708899226-shelved',owner='314ef71af4864309b93505438743151f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T15:41:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:43:36 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:43:36 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='69dd29f2c70ea505a14741accc5dbb08',container_format='bare',created_at=2023-10-23T15:41:35Z,direct_url=<?>,disk_format='qcow2',id=a995208e-856d-4c80-ba65-9e25114c1fb6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-708899226-shelved',owner='314ef71af4864309b93505438743151f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T15:41:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.objects.base [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-708899226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-708899226',id=37,image_ref='a995208e-856d-4c80-ba65-9e25114c1fb6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1026354056',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-icsh0y35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member',shelved_at='2023-10-23T15:41:40.956625',shelved_host='user',shelved_image_id='a995208e-856d-4c80-ba65-9e25114c1fb6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.objects.base [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Object Instance<6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:43:36 user nova-compute[74421]:   <uuid>6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee</uuid>
Oct 23 15:43:36 user nova-compute[74421]:   <name>instance-00000025</name>
Oct 23 15:43:36 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:43:36 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:43:36 user nova-compute[74421]:   <metadata>
Oct 23 15:43:36 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:43:36 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:43:36 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-708899226</nova:name>
Oct 23 15:43:36 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:43:36</nova:creationTime>
Oct 23 15:43:36 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:43:36 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:43:36 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:43:36 user nova-compute[74421]:       <nova:owner>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:user uuid="6fd182e97e984debb9f71886b04df9bc">tempest-AttachVolumeShelveTestJSON-1510181551-project-member</nova:user>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:project uuid="314ef71af4864309b93505438743151f">tempest-AttachVolumeShelveTestJSON-1510181551</nova:project>
Oct 23 15:43:36 user nova-compute[74421]:       </nova:owner>
Oct 23 15:43:36 user nova-compute[74421]:       <nova:root type="image" uuid="a995208e-856d-4c80-ba65-9e25114c1fb6"/>
Oct 23 15:43:36 user nova-compute[74421]:       <nova:ports>
Oct 23 15:43:36 user nova-compute[74421]:         <nova:port uuid="43a0cdb2-cb72-44a7-b132-67a37512c70a">
Oct 23 15:43:36 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:43:36 user nova-compute[74421]:         </nova:port>
Oct 23 15:43:36 user nova-compute[74421]:       </nova:ports>
Oct 23 15:43:36 user nova-compute[74421]:     </nova:instance>
Oct 23 15:43:36 user nova-compute[74421]:   </metadata>
Oct 23 15:43:36 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:43:36 user nova-compute[74421]:     <system>
Oct 23 15:43:36 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:43:36 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:43:36 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:43:36 user nova-compute[74421]:       <entry name="serial">6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee</entry>
Oct 23 15:43:36 user nova-compute[74421]:       <entry name="uuid">6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee</entry>
Oct 23 15:43:36 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:43:36 user nova-compute[74421]:     </system>
Oct 23 15:43:36 user nova-compute[74421]:   </sysinfo>
Oct 23 15:43:36 user nova-compute[74421]:   <os>
Oct 23 15:43:36 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:43:36 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:43:36 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:43:36 user nova-compute[74421]:   </os>
Oct 23 15:43:36 user nova-compute[74421]:   <features>
Oct 23 15:43:36 user nova-compute[74421]:     <acpi/>
Oct 23 15:43:36 user nova-compute[74421]:     <apic/>
Oct 23 15:43:36 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:43:36 user nova-compute[74421]:   </features>
Oct 23 15:43:36 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:43:36 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:43:36 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:43:36 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:43:36 user nova-compute[74421]:   </clock>
Oct 23 15:43:36 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:43:36 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:43:36 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:43:36 user nova-compute[74421]:   </cpu>
Oct 23 15:43:36 user nova-compute[74421]:   <devices>
Oct 23 15:43:36 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:43:36 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:43:36 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk"/>
Oct 23 15:43:36 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:43:36 user nova-compute[74421]:     </disk>
Oct 23 15:43:36 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:43:36 user nova-compute[74421]:       <mac address="fa:16:3e:25:27:db"/>
Oct 23 15:43:36 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:43:36 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:43:36 user nova-compute[74421]:       <target dev="tap43a0cdb2-cb"/>
Oct 23 15:43:36 user nova-compute[74421]:     </interface>
Oct 23 15:43:36 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:43:36 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/console.log" append="off"/>
Oct 23 15:43:36 user nova-compute[74421]:     </serial>
Oct 23 15:43:36 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:43:36 user nova-compute[74421]:     <video>
Oct 23 15:43:36 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:43:36 user nova-compute[74421]:     </video>
Oct 23 15:43:36 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:43:36 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:43:36 user nova-compute[74421]:     </rng>
Oct 23 15:43:36 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:43:36 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:43:36 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:43:36 user nova-compute[74421]:     </memballoon>
Oct 23 15:43:36 user nova-compute[74421]:   </devices>
Oct 23 15:43:36 user nova-compute[74421]: </domain>
Oct 23 15:43:36 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-708899226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-708899226',id=37,image_ref='a995208e-856d-4c80-ba65-9e25114c1fb6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1026354056',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-icsh0y35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member',shelved_at='2023-10-23T15:41:40.956625',shelved_host='user',shelved_image_id='a995208e-856d-4c80-ba65-9e25114c1fb6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG os_vif [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0568514a-624e-5376-b2b8-617d26624a1e', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43a0cdb2-cb, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43a0cdb2-cb, col_values=(('qos', UUID('3b212fb6-7016-499a-a0b7-201a56e649d8')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43a0cdb2-cb, col_values=(('external_ids', {'iface-id': '43a0cdb2-cb72-44a7-b132-67a37512c70a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:27:db', 'vm-uuid': '6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:36 user nova-compute[74421]: INFO os_vif [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb')
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:43:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] No VIF found with MAC fa:16:3e:25:27:db, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-bb4395b6-1348-432f-886c-1676519d8841 req-a4163b4c-2baf-4e39-84aa-14170aaf1dfa service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bb4395b6-1348-432f-886c-1676519d8841 req-a4163b4c-2baf-4e39-84aa-14170aaf1dfa service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bb4395b6-1348-432f-886c-1676519d8841 req-a4163b4c-2baf-4e39-84aa-14170aaf1dfa service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bb4395b6-1348-432f-886c-1676519d8841 req-a4163b4c-2baf-4e39-84aa-14170aaf1dfa service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:38 user nova-compute[74421]: DEBUG nova.compute.manager [req-bb4395b6-1348-432f-886c-1676519d8841 req-a4163b4c-2baf-4e39-84aa-14170aaf1dfa service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:43:38 user nova-compute[74421]: WARNING nova.compute.manager [req-bb4395b6-1348-432f-886c-1676519d8841 req-a4163b4c-2baf-4e39-84aa-14170aaf1dfa service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 15:43:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-2eb255e5-033d-42ac-aee8-c11c0abd28b4 req-51c7d873-d207-4f48-8911-cee19923e15a service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:43:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2eb255e5-033d-42ac-aee8-c11c0abd28b4 req-51c7d873-d207-4f48-8911-cee19923e15a service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2eb255e5-033d-42ac-aee8-c11c0abd28b4 req-51c7d873-d207-4f48-8911-cee19923e15a service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2eb255e5-033d-42ac-aee8-c11c0abd28b4 req-51c7d873-d207-4f48-8911-cee19923e15a service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-2eb255e5-033d-42ac-aee8-c11c0abd28b4 req-51c7d873-d207-4f48-8911-cee19923e15a service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:43:40 user nova-compute[74421]: WARNING nova.compute.manager [req-2eb255e5-033d-42ac-aee8-c11c0abd28b4 req-51c7d873-d207-4f48-8911-cee19923e15a service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 15:43:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:43:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:43:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance spawned successfully.
Oct 23 15:43:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:43:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b998dbff-93bc-489d-91eb-c49a6538c5ff tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.008s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:45 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 146c13ae-a37f-406d-8dc6-13f0413efdae is timed out.
Oct 23 15:43:45 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully detached device vdb from instance 146c13ae-a37f-406d-8dc6-13f0413efdae from the live domain config.
Oct 23 15:43:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaKIbLrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:43:45 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:43:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[289c91a4-00c5-4a2e-bbe1-e2034b7f9f5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:43:45 user nova-compute[74421]: No targets found.
Oct 23 15:43:45 user nova-compute[74421]: iSNS:
Oct 23 15:43:45 user nova-compute[74421]: No targets found.
Oct 23 15:43:45 user nova-compute[74421]: STATIC:
Oct 23 15:43:45 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051
Oct 23 15:43:45 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:43:45 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:43:45 user nova-compute[74421]: FIRMWARE:
Oct 23 15:43:45 user nova-compute[74421]: No targets found.
Oct 23 15:43:45 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:43:45 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:43:45 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3667c-8977-4e0d-8478-e9b3dd23518d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60c248-860c-4beb-a28f-bffef05a0203]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:43:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 (non-flash)
Oct 23 15:43:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2480402710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f7446-432e-4534-aaad-06d55b40e526]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b81335-67b1-4726-9b7b-f0b81ad3156e]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f888313-a0ca-447f-ae9e-fa737b9d14a7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf753ea8-b10e-4ba1-821f-e87f808c2138]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43c0847-ef3b-40c7-8b9c-07f0d52dfc11]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[867400e4-d6ed-45f7-b66a-6a282af6c52c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260]
Oct 23 15:43:46 user nova-compute[74421]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051, portal: 172.16.0.220,3260] successful.
Oct 23 15:43:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c84120-4b83-4da3-a9cd-4b48057dc051 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d321e4-79d0-4b2c-9ea1-bc482752e395]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] <== disconnect_volume: return (341ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:43:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:43:47 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [{"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:43:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:43:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:43:48 user nova-compute[74421]: DEBUG nova.objects.instance [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'flavor' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:43:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-75deda48-bb39-41bf-98a1-3b3d8ad0873d tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.572s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:43:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:55 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:43:55 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:43:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.05608367919922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:43:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 146c13ae-a37f-406d-8dc6-13f0413efdae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d937f218-8349-4e47-a8da-5cea5d6d70a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:43:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:43:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:43:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:43:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:01 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:15 user nova-compute[74421]: INFO nova.compute.manager [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Terminating instance
Oct 23 15:44:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-c9439f2d-bc37-4ad7-a9bd-2d1ac99e866c req-c7b34fb2-f963-4e17-837f-777955b6e121 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c9439f2d-bc37-4ad7-a9bd-2d1ac99e866c req-c7b34fb2-f963-4e17-837f-777955b6e121 service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c9439f2d-bc37-4ad7-a9bd-2d1ac99e866c req-c7b34fb2-f963-4e17-837f-777955b6e121 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c9439f2d-bc37-4ad7-a9bd-2d1ac99e866c req-c7b34fb2-f963-4e17-837f-777955b6e121 service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-c9439f2d-bc37-4ad7-a9bd-2d1ac99e866c req-c7b34fb2-f963-4e17-837f-777955b6e121 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.compute.manager [req-c9439f2d-bc37-4ad7-a9bd-2d1ac99e866c req-c7b34fb2-f963-4e17-837f-777955b6e121 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-unplugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:44:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Instance destroyed successfully.
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.objects.instance [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'resources' on Instance uuid 146c13ae-a37f-406d-8dc6-13f0413efdae {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827231928',display_name='tempest-ServerRescueNegativeTestJSON-server-827231928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827231928',id=35,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8MdfSc5yON++t/AhakxtvmgxaNarlEI8Y5Bh9DMvYe9b/V9EZ2FEFc/eLDRPIcZ9oKQGvW6cYoDO1i6g421BLgXOwmCn0Ex+IXTAnYeDleENYS3/rdAUK1BU5vAFWJPQ==',key_name='tempest-keypair-1566777487',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-5hg9m7at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=146c13ae-a37f-406d-8dc6-13f0413efdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "01e85c82-ce95-4efc-b892-7195d64b52c8", "address": "fa:16:3e:3b:13:c0", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e85c82-ce", "ovs_interfaceid": "01e85c82-ce95-4efc-b892-7195d64b52c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG os_vif [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01e85c82-ce, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10c82d26-0463-44ca-9457-103d0d0dda7c) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:16 user nova-compute[74421]: INFO os_vif [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:13:c0,bridge_name='br-int',has_traffic_filtering=True,id=01e85c82-ce95-4efc-b892-7195d64b52c8,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e85c82-ce')
Oct 23 15:44:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Deleting instance files /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae_del
Oct 23 15:44:16 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Deletion of /opt/stack/data/nova/instances/146c13ae-a37f-406d-8dc6-13f0413efdae_del complete
Oct 23 15:44:16 user nova-compute[74421]: INFO nova.compute.manager [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 23 15:44:16 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:44:16 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:44:17 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:44:17 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Took 1.08 seconds to deallocate network for instance.
Oct 23 15:44:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-0bcddd0d-377a-410f-9dfc-7c0b505e928b req-a10abaf8-e3dd-4b7b-9cd3-d706af6be5f3 service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-deleted-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:18 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Deleted allocations for instance 146c13ae-a37f-406d-8dc6-13f0413efdae
Oct 23 15:44:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-e33d8a13-2d8c-4966-9901-6962c6099c02 req-b85ff4a6-0984-40d8-a2e0-47072064c96a service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e33d8a13-2d8c-4966-9901-6962c6099c02 req-b85ff4a6-0984-40d8-a2e0-47072064c96a service nova] Acquiring lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e33d8a13-2d8c-4966-9901-6962c6099c02 req-b85ff4a6-0984-40d8-a2e0-47072064c96a service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e33d8a13-2d8c-4966-9901-6962c6099c02 req-b85ff4a6-0984-40d8-a2e0-47072064c96a service nova] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-e33d8a13-2d8c-4966-9901-6962c6099c02 req-b85ff4a6-0984-40d8-a2e0-47072064c96a service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] No waiting events found dispatching network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:44:18 user nova-compute[74421]: WARNING nova.compute.manager [req-e33d8a13-2d8c-4966-9901-6962c6099c02 req-b85ff4a6-0984-40d8-a2e0-47072064c96a service nova] [instance: 146c13ae-a37f-406d-8dc6-13f0413efdae] Received unexpected event network-vif-plugged-01e85c82-ce95-4efc-b892-7195d64b52c8 for instance with vm_state deleted and task_state None.
Oct 23 15:44:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db64f8e1-72e7-4762-b57b-68b97ed27ee1 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "146c13ae-a37f-406d-8dc6-13f0413efdae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:30 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:44:30 user nova-compute[74421]: INFO nova.compute.claims [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Claim successful on node user
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:44:31 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.policy [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae006290eb4d49609eee46250660adb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3c0fda43d4b42a16478be0d47270b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:44:31 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Creating image(s)
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "f3eba8b2739a15951719db7fdb3818ee991d50b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "f3eba8b2739a15951719db7fdb3818ee991d50b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Successfully created port: 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.virt.images [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] 578f8aba-8ffe-4510-ad09-e6a6a2942eba was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.part /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.part /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.converted" returned: 0 in 0.292s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "f3eba8b2739a15951719db7fdb3818ee991d50b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.164s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.network.neutron [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Successfully updated port: 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-changed-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing instance network info cache due to event network-changed-37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "f3eba8b2739a15951719db7fdb3818ee991d50b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "f3eba8b2739a15951719db7fdb3818ee991d50b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ba2a0b99-a8c9-4b48-9a36-4a28689824ad req-cc6ac716-23fe-48c0-a961-59dc8107aabe service nova] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG nova.network.neutron [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json" returned: 0 in 0.169s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7,backing_fmt=raw /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7,backing_fmt=raw /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk 1073741824" returned: 0 in 0.048s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "f3eba8b2739a15951719db7fdb3818ee991d50b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance network_info: |[{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Cannot resize image /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Ensure instance console log exists: /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Start _get_guest_xml network_info=[{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:44:28Z,direct_url=<?>,disk_format='qcow2',id=578f8aba-8ffe-4510-ad09-e6a6a2942eba,min_disk=0,min_ram=0,name='tempest-scenario-img--1264432184',owner='88f3c0fda43d4b42a16478be0d47270b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:44:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '578f8aba-8ffe-4510-ad09-e6a6a2942eba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:44:33 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:44:33 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:44:28Z,direct_url=<?>,disk_format='qcow2',id=578f8aba-8ffe-4510-ad09-e6a6a2942eba,min_disk=0,min_ram=0,name='tempest-scenario-img--1264432184',owner='88f3c0fda43d4b42a16478be0d47270b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:44:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-690149044',display_name='tempest-TestMinimumBasicScenario-server-690149044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-690149044',id=40,image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVrF6qY32TP+U8xhcaM85ZRVobVNM9KWn0MAOa0iFqRENM4CzxRwRVyVl4Q33cN97Dbd0TCutwWn09XIFcGfTwv8Xv8LwjulpM5xzb24oLw07DAlcM99yCzGfLG0QAC9Q==',key_name='tempest-TestMinimumBasicScenario-966738554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-0zcaq5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:44:31Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=fd38a03f-899c-440f-b9a4-3311884941c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.objects.instance [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'pci_devices' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:44:33 user nova-compute[74421]:   <uuid>fd38a03f-899c-440f-b9a4-3311884941c3</uuid>
Oct 23 15:44:33 user nova-compute[74421]:   <name>instance-00000028</name>
Oct 23 15:44:33 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:44:33 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:44:33 user nova-compute[74421]:   <metadata>
Oct 23 15:44:33 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:44:33 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:44:33 user nova-compute[74421]:       <nova:name>tempest-TestMinimumBasicScenario-server-690149044</nova:name>
Oct 23 15:44:33 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:44:33</nova:creationTime>
Oct 23 15:44:33 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:44:33 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:44:33 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:44:33 user nova-compute[74421]:       <nova:owner>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:user uuid="ae006290eb4d49609eee46250660adb8">tempest-TestMinimumBasicScenario-1824567034-project-member</nova:user>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:project uuid="88f3c0fda43d4b42a16478be0d47270b">tempest-TestMinimumBasicScenario-1824567034</nova:project>
Oct 23 15:44:33 user nova-compute[74421]:       </nova:owner>
Oct 23 15:44:33 user nova-compute[74421]:       <nova:root type="image" uuid="578f8aba-8ffe-4510-ad09-e6a6a2942eba"/>
Oct 23 15:44:33 user nova-compute[74421]:       <nova:ports>
Oct 23 15:44:33 user nova-compute[74421]:         <nova:port uuid="37875513-43bb-490a-bddf-7b8523dc998e">
Oct 23 15:44:33 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 15:44:33 user nova-compute[74421]:         </nova:port>
Oct 23 15:44:33 user nova-compute[74421]:       </nova:ports>
Oct 23 15:44:33 user nova-compute[74421]:     </nova:instance>
Oct 23 15:44:33 user nova-compute[74421]:   </metadata>
Oct 23 15:44:33 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:44:33 user nova-compute[74421]:     <system>
Oct 23 15:44:33 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:44:33 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:44:33 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:44:33 user nova-compute[74421]:       <entry name="serial">fd38a03f-899c-440f-b9a4-3311884941c3</entry>
Oct 23 15:44:33 user nova-compute[74421]:       <entry name="uuid">fd38a03f-899c-440f-b9a4-3311884941c3</entry>
Oct 23 15:44:33 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:44:33 user nova-compute[74421]:     </system>
Oct 23 15:44:33 user nova-compute[74421]:   </sysinfo>
Oct 23 15:44:33 user nova-compute[74421]:   <os>
Oct 23 15:44:33 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:44:33 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:44:33 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:44:33 user nova-compute[74421]:   </os>
Oct 23 15:44:33 user nova-compute[74421]:   <features>
Oct 23 15:44:33 user nova-compute[74421]:     <acpi/>
Oct 23 15:44:33 user nova-compute[74421]:     <apic/>
Oct 23 15:44:33 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:44:33 user nova-compute[74421]:   </features>
Oct 23 15:44:33 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:44:33 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:44:33 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:44:33 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:44:33 user nova-compute[74421]:   </clock>
Oct 23 15:44:33 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:44:33 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:44:33 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:44:33 user nova-compute[74421]:   </cpu>
Oct 23 15:44:33 user nova-compute[74421]:   <devices>
Oct 23 15:44:33 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:44:33 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:44:33 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk"/>
Oct 23 15:44:33 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:44:33 user nova-compute[74421]:     </disk>
Oct 23 15:44:33 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:44:33 user nova-compute[74421]:       <mac address="fa:16:3e:43:ed:0d"/>
Oct 23 15:44:33 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:44:33 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:44:33 user nova-compute[74421]:       <target dev="tap37875513-43"/>
Oct 23 15:44:33 user nova-compute[74421]:     </interface>
Oct 23 15:44:33 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:44:33 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/console.log" append="off"/>
Oct 23 15:44:33 user nova-compute[74421]:     </serial>
Oct 23 15:44:33 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:44:33 user nova-compute[74421]:     <video>
Oct 23 15:44:33 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:44:33 user nova-compute[74421]:     </video>
Oct 23 15:44:33 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:44:33 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:44:33 user nova-compute[74421]:     </rng>
Oct 23 15:44:33 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:44:33 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:44:33 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:44:33 user nova-compute[74421]:     </memballoon>
Oct 23 15:44:33 user nova-compute[74421]:   </devices>
Oct 23 15:44:33 user nova-compute[74421]: </domain>
Oct 23 15:44:33 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-690149044',display_name='tempest-TestMinimumBasicScenario-server-690149044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-690149044',id=40,image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVrF6qY32TP+U8xhcaM85ZRVobVNM9KWn0MAOa0iFqRENM4CzxRwRVyVl4Q33cN97Dbd0TCutwWn09XIFcGfTwv8Xv8LwjulpM5xzb24oLw07DAlcM99yCzGfLG0QAC9Q==',key_name='tempest-TestMinimumBasicScenario-966738554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-0zcaq5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:44:31Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=fd38a03f-899c-440f-b9a4-3311884941c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG os_vif [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b1434d-4165-521b-992c-5b066efb5a11', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37875513-43, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37875513-43, col_values=(('qos', UUID('2bab6f6b-596d-4ecc-9361-d97157d6eb99')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37875513-43, col_values=(('external_ids', {'iface-id': '37875513-43bb-490a-bddf-7b8523dc998e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ed:0d', 'vm-uuid': 'fd38a03f-899c-440f-b9a4-3311884941c3'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:33 user nova-compute[74421]: INFO os_vif [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43')
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:44:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No VIF found with MAC fa:16:3e:43:ed:0d, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:44:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-03098745-1626-4c24-ad53-36536ad66d1f req-4e3e1247-1fce-441d-b679-d5887506b149 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-03098745-1626-4c24-ad53-36536ad66d1f req-4e3e1247-1fce-441d-b679-d5887506b149 service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-03098745-1626-4c24-ad53-36536ad66d1f req-4e3e1247-1fce-441d-b679-d5887506b149 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-03098745-1626-4c24-ad53-36536ad66d1f req-4e3e1247-1fce-441d-b679-d5887506b149 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-03098745-1626-4c24-ad53-36536ad66d1f req-4e3e1247-1fce-441d-b679-d5887506b149 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:44:35 user nova-compute[74421]: WARNING nova.compute.manager [req-03098745-1626-4c24-ad53-36536ad66d1f req-4e3e1247-1fce-441d-b679-d5887506b149 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state building and task_state spawning.
Oct 23 15:44:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:44:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance spawned successfully.
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:44:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:44:37 user nova-compute[74421]: INFO nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 23 15:44:37 user nova-compute[74421]: DEBUG nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:44:37 user nova-compute[74421]: INFO nova.compute.manager [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Took 6.31 seconds to build instance.
Oct 23 15:44:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-753a2c98-0927-4ce3-ba13-fd519028b7f2 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.415s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-7bdd3499-0d82-4c08-9b79-bc30e79b2a21 req-9e9c7b72-8b94-41e3-9fa6-4615372a7c75 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7bdd3499-0d82-4c08-9b79-bc30e79b2a21 req-9e9c7b72-8b94-41e3-9fa6-4615372a7c75 service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7bdd3499-0d82-4c08-9b79-bc30e79b2a21 req-9e9c7b72-8b94-41e3-9fa6-4615372a7c75 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7bdd3499-0d82-4c08-9b79-bc30e79b2a21 req-9e9c7b72-8b94-41e3-9fa6-4615372a7c75 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-7bdd3499-0d82-4c08-9b79-bc30e79b2a21 req-9e9c7b72-8b94-41e3-9fa6-4615372a7c75 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:44:37 user nova-compute[74421]: WARNING nova.compute.manager [req-7bdd3499-0d82-4c08-9b79-bc30e79b2a21 req-9e9c7b72-8b94-41e3-9fa6-4615372a7c75 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state active and task_state None.
Oct 23 15:44:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:47 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:47 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:44:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:44:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:44:47 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [{"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-19b0c20d-3f1a-4897-852a-9fb248f5d5f7" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-changed-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Refreshing instance network info cache due to event network-changed-c4315ece-59ee-4bc5-af08-8490573ba593. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] Acquiring lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] Acquired lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Refreshing network info cache for port c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.objects.instance [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'flavor' on Instance uuid d937f218-8349-4e47-a8da-5cea5d6d70a5 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:44:48 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Ignoring supplied device name: /dev/vdb
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updated VIF entry in instance network info cache for port c4315ece-59ee-4bc5-af08-8490573ba593. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating instance_info_cache with network_info: [{"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:48 user nova-compute[74421]: INFO nova.compute.manager [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Attaching volume a4db684f-adfa-4e52-8066-bdd986b0a5fd to /dev/vdb
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-10a3c544-6955-4e34-a196-5000d477a83f req-1bb81cb1-1af6-4d27-85e4-9f5d334613c9 service nova] Releasing lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG os_brick.utils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83d1b8-8f44-4f86-9f66-b96c8f96e5b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad3b8b3-0450-4dff-85bf-bb51f0520d63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee417e55-4a7f-4be9-80da-2cd5623babfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c669e5-3481-49d3-bb9d-1d84266a4be4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:44:49 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:44:49 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9c527a-596d-471d-b867-f9b20bec102a]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG os_brick.utils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:44:49 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating existing volume attachment record: 07a74fd8-bf78-4598-b5cc-4012ee0ee6c5 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:44:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:52 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:52 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:44:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:53 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:44:55 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:44:55 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8334MB free_disk=24.984989166259766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d937f218-8349-4e47-a8da-5cea5d6d70a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fd38a03f-899c-440f-b9a4-3311884941c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:44:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:44:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:44:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:44:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:45:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:19 user nova-compute[74421]: INFO nova.compute.manager [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Terminating instance
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-7434f43a-079b-4132-942c-212e177d6880 req-cc1521b4-fae9-44de-b908-7b91ee99bfd9 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7434f43a-079b-4132-942c-212e177d6880 req-cc1521b4-fae9-44de-b908-7b91ee99bfd9 service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7434f43a-079b-4132-942c-212e177d6880 req-cc1521b4-fae9-44de-b908-7b91ee99bfd9 service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7434f43a-079b-4132-942c-212e177d6880 req-cc1521b4-fae9-44de-b908-7b91ee99bfd9 service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-7434f43a-079b-4132-942c-212e177d6880 req-cc1521b4-fae9-44de-b908-7b91ee99bfd9 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-7434f43a-079b-4132-942c-212e177d6880 req-cc1521b4-fae9-44de-b908-7b91ee99bfd9 service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Instance destroyed successfully.
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lazy-loading 'resources' on Instance uuid 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T15:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-708899226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-708899226',id=37,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs2SJ3PWp8n1rZk+PqNlU/0TBjdJzfsVR5RXje4n8pWqSXgt2G70Zu90AZaj+CcqTUPLncgCtsTDJIvmstQIS9h3mCXuIIH5u65ApT9s1vhj70zZB2hFiY7VXD5pu3vhg==',key_name='tempest-keypair-1026354056',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='314ef71af4864309b93505438743151f',ramdisk_id='',reservation_id='r-icsh0y35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1510181551',owner_user_name='tempest-AttachVolumeShelveTestJSON-1510181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:43:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd182e97e984debb9f71886b04df9bc',uuid=6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converting VIF {"id": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "address": "fa:16:3e:25:27:db", "network": {"id": "9b95fc27-ae74-4850-a288-585667b3ad78", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-900061702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "314ef71af4864309b93505438743151f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a0cdb2-cb", "ovs_interfaceid": "43a0cdb2-cb72-44a7-b132-67a37512c70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG os_vif [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43a0cdb2-cb, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b212fb6-7016-499a-a0b7-201a56e649d8) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: INFO os_vif [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:27:db,bridge_name='br-int',has_traffic_filtering=True,id=43a0cdb2-cb72-44a7-b132-67a37512c70a,network=Network(9b95fc27-ae74-4850-a288-585667b3ad78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a0cdb2-cb')
Oct 23 15:45:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Deleting instance files /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee_del
Oct 23 15:45:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Deletion of /opt/stack/data/nova/instances/6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee_del complete
Oct 23 15:45:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:19 user nova-compute[74421]: INFO nova.compute.manager [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Took 0.81 seconds to destroy the instance on the hypervisor.
Oct 23 15:45:19 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:45:19 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:45:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:45:21 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Took 1.23 seconds to deallocate network for instance.
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:21 user nova-compute[74421]: WARNING nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state deleted and task_state None.
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:21 user nova-compute[74421]: WARNING nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state deleted and task_state None.
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:21 user nova-compute[74421]: WARNING nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state deleted and task_state None.
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:21 user nova-compute[74421]: WARNING nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-unplugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state deleted and task_state None.
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Acquiring lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] No waiting events found dispatching network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:21 user nova-compute[74421]: WARNING nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received unexpected event network-vif-plugged-43a0cdb2-cb72-44a7-b132-67a37512c70a for instance with vm_state deleted and task_state None.
Oct 23 15:45:21 user nova-compute[74421]: DEBUG nova.compute.manager [req-6d903979-f3fd-485d-837d-744d5323f2da req-903437ec-067e-49f6-a641-6c75c7678cbd service nova] [instance: 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee] Received event network-vif-deleted-43a0cdb2-cb72-44a7-b132-67a37512c70a {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:21 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Deleted allocations for instance 6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee
Oct 23 15:45:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a3caf9f6-cadf-4e9d-af50-38e363b4af7d tempest-AttachVolumeShelveTestJSON-1510181551 tempest-AttachVolumeShelveTestJSON-1510181551-project-member] Lock "6b309e9b-c8b2-47e0-8cfa-09cfeb15c3ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.593s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfqvXPHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:45:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:45:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:45:24 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c6eea-5eff-40ed-a8ff-6dbf50f1b1f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:45:24 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5332d9-50ea-4f9c-8f66-b7c4f4c0249e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd] added
Oct 23 15:45:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f9da40-54b0-4e2b-9b36-638f2dc374d0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f2c90-8da8-465e-8dd6-e05bc7db0d10]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfqvXPHM {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfqvXPHM" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc278c47-20b6-4c07-b7bb-b685fbde43af]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfqvXPHM'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de2703-c77b-4cf0-80a3-504c4fc33e26]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df7b80-46fa-4a70-99ae-b265c1c700bf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:45:24 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:45:24 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:45:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 15:45:24 user nova-compute[74421]: 
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba82783-8751-48ea-8ff1-1110f607eb53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260]
Oct 23 15:45:24 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260] successful.
Oct 23 15:45:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd31fb58-d982-46cc-92d2-fb668503272a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[acebd7da-87a0-4d9d-b698-a3c25b24ad86]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd (non-flash)
Oct 23 15:45:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd (non-flash)
Oct 23 15:45:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[849fdaab-713a-4639-a761-9635988f288d]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfqvXPHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:45:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26433353339376264', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433353339376264', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'flavor' on Instance uuid d937f218-8349-4e47-a8da-5cea5d6d70a5 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:45:25 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:45:25 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:45:25 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:45:25 user nova-compute[74421]:   <serial>a4db684f-adfa-4e52-8066-bdd986b0a5fd</serial>
Oct 23 15:45:25 user nova-compute[74421]: </disk>
Oct 23 15:45:25 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:45:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] No VIF found with MAC fa:16:3e:f9:8b:c7, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1325e9f3-87d8-479f-953f-905a75fbb580 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.073s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:26 user nova-compute[74421]: INFO nova.compute.manager [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Terminating instance
Oct 23 15:45:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-57de6f40-3139-44d3-8303-4594605e3df3 req-e41a1484-341b-41a6-bf82-b6cdb4d25cc0 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-unplugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-57de6f40-3139-44d3-8303-4594605e3df3 req-e41a1484-341b-41a6-bf82-b6cdb4d25cc0 service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-57de6f40-3139-44d3-8303-4594605e3df3 req-e41a1484-341b-41a6-bf82-b6cdb4d25cc0 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-57de6f40-3139-44d3-8303-4594605e3df3 req-e41a1484-341b-41a6-bf82-b6cdb4d25cc0 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-57de6f40-3139-44d3-8303-4594605e3df3 req-e41a1484-341b-41a6-bf82-b6cdb4d25cc0 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-unplugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-57de6f40-3139-44d3-8303-4594605e3df3 req-e41a1484-341b-41a6-bf82-b6cdb4d25cc0 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-unplugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:45:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Instance destroyed successfully.
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.objects.instance [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'resources' on Instance uuid 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-659659007',display_name='tempest-ServerRescueNegativeTestJSON-server-659659007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-659659007',id=21,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-2s0cbhg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:30:47Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=19b0c20d-3f1a-4897-852a-9fb248f5d5f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "address": "fa:16:3e:ab:4d:45", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0274fe50-08", "ovs_interfaceid": "0274fe50-08cc-4f3f-aca6-ec69220dfbfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG os_vif [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0274fe50-08, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78146dda-7bc6-4ef3-aaa2-510d33074765) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:45:27 user nova-compute[74421]: INFO os_vif [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4d:45,bridge_name='br-int',has_traffic_filtering=True,id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0274fe50-08')
Oct 23 15:45:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Deleting instance files /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7_del
Oct 23 15:45:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Deletion of /opt/stack/data/nova/instances/19b0c20d-3f1a-4897-852a-9fb248f5d5f7_del complete
Oct 23 15:45:27 user nova-compute[74421]: INFO nova.compute.manager [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 23 15:45:27 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:45:27 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Took 0.48 seconds to deallocate network for instance.
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-a1cee7eb-c541-4463-9391-01bd6106830a req-ed91e159-3160-447c-ad47-0467659058d6 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-deleted-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:27 user nova-compute[74421]: INFO nova.compute.manager [req-a1cee7eb-c541-4463-9391-01bd6106830a req-ed91e159-3160-447c-ad47-0467659058d6 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Neutron deleted interface 0274fe50-08cc-4f3f-aca6-ec69220dfbfc; detaching it from the instance and deleting it from the info cache
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-a1cee7eb-c541-4463-9391-01bd6106830a req-ed91e159-3160-447c-ad47-0467659058d6 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-a1cee7eb-c541-4463-9391-01bd6106830a req-ed91e159-3160-447c-ad47-0467659058d6 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Detach interface failed, port_id=0274fe50-08cc-4f3f-aca6-ec69220dfbfc, reason: Instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:45:27 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:45:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:28 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Deleted allocations for instance 19b0c20d-3f1a-4897-852a-9fb248f5d5f7
Oct 23 15:45:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bec7743e-c0fd-4185-ba7b-2f69d1134165 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.732s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-8db6099a-007a-4987-90ab-bf7d751e6983 req-cacb7850-7659-45fb-849b-ef5daf5cc054 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:45:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8db6099a-007a-4987-90ab-bf7d751e6983 req-cacb7850-7659-45fb-849b-ef5daf5cc054 service nova] Acquiring lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8db6099a-007a-4987-90ab-bf7d751e6983 req-cacb7850-7659-45fb-849b-ef5daf5cc054 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8db6099a-007a-4987-90ab-bf7d751e6983 req-cacb7850-7659-45fb-849b-ef5daf5cc054 service nova] Lock "19b0c20d-3f1a-4897-852a-9fb248f5d5f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-8db6099a-007a-4987-90ab-bf7d751e6983 req-cacb7850-7659-45fb-849b-ef5daf5cc054 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] No waiting events found dispatching network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:45:28 user nova-compute[74421]: WARNING nova.compute.manager [req-8db6099a-007a-4987-90ab-bf7d751e6983 req-cacb7850-7659-45fb-849b-ef5daf5cc054 service nova] [instance: 19b0c20d-3f1a-4897-852a-9fb248f5d5f7] Received unexpected event network-vif-plugged-0274fe50-08cc-4f3f-aca6-ec69220dfbfc for instance with vm_state deleted and task_state None.
Oct 23 15:45:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:45:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:45:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:49 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:45:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:45:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:45:49 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:45:50 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating instance_info_cache with network_info: [{"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:45:50 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-d937f218-8349-4e47-a8da-5cea5d6d70a5" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:45:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:45:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:45:54 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:54 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:45:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:55 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:45:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:45:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.037097930908203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d937f218-8349-4e47-a8da-5cea5d6d70a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fd38a03f-899c-440f-b9a4-3311884941c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:45:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:45:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:45:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:45:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:46:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:13 user nova-compute[74421]: INFO nova.compute.manager [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Detaching volume a4db684f-adfa-4e52-8066-bdd986b0a5fd
Oct 23 15:46:14 user nova-compute[74421]: INFO nova.virt.block_device [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Attempting to driver detach volume a4db684f-adfa-4e52-8066-bdd986b0a5fd from mountpoint /dev/vdb
Oct 23 15:46:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Attempting to detach device vdb from instance d937f218-8349-4e47-a8da-5cea5d6d70a5 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:46:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:46:14 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:46:14 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:46:14 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:46:14 user nova-compute[74421]:   <serial>a4db684f-adfa-4e52-8066-bdd986b0a5fd</serial>
Oct 23 15:46:14 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:46:14 user nova-compute[74421]: </disk>
Oct 23 15:46:14 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:46:14 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully detached device vdb from instance d937f218-8349-4e47-a8da-5cea5d6d70a5 from the persistent domain config.
Oct 23 15:46:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d937f218-8349-4e47-a8da-5cea5d6d70a5 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:46:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:46:14 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:46:14 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:46:14 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:46:14 user nova-compute[74421]:   <serial>a4db684f-adfa-4e52-8066-bdd986b0a5fd</serial>
Oct 23 15:46:14 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:46:14 user nova-compute[74421]: </disk>
Oct 23 15:46:14 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:46:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:14 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d937f218-8349-4e47-a8da-5cea5d6d70a5 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:17 user nova-compute[74421]: INFO nova.compute.manager [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Terminating instance
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-36a59a69-75ea-4f84-acb5-0f4ef0ad5c5a req-5c2d4714-5765-405d-932b-fa51c5300e37 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-36a59a69-75ea-4f84-acb5-0f4ef0ad5c5a req-5c2d4714-5765-405d-932b-fa51c5300e37 service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-36a59a69-75ea-4f84-acb5-0f4ef0ad5c5a req-5c2d4714-5765-405d-932b-fa51c5300e37 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-36a59a69-75ea-4f84-acb5-0f4ef0ad5c5a req-5c2d4714-5765-405d-932b-fa51c5300e37 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-36a59a69-75ea-4f84-acb5-0f4ef0ad5c5a req-5c2d4714-5765-405d-932b-fa51c5300e37 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-36a59a69-75ea-4f84-acb5-0f4ef0ad5c5a req-5c2d4714-5765-405d-932b-fa51c5300e37 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-unplugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:46:17 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Instance destroyed successfully.
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.objects.instance [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lazy-loading 'resources' on Instance uuid b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2013166828',display_name='tempest-ServerRescueNegativeTestJSON-server-2013166828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2013166828',id=20,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8ed209b95549e8a0d77ead103b1c1a',ramdisk_id='',reservation_id='r-ealwh0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1858635885',owner_user_name='tempest-ServerRescueNegativeTestJSON-1858635885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:35:34Z,user_data=None,user_id='6b5629aa90fa4b40b4886cb46dc21e65',uuid=b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converting VIF {"id": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "address": "fa:16:3e:22:e3:17", "network": {"id": "b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-618007119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8ed209b95549e8a0d77ead103b1c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa74a98c-d6", "ovs_interfaceid": "fa74a98c-d6f5-4ce5-8a5f-343dc7372e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG os_vif [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa74a98c-d6, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5bbe2c8-6268-4055-8f54-e922638650af) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:46:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:46:18 user nova-compute[74421]: INFO os_vif [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e3:17,bridge_name='br-int',has_traffic_filtering=True,id=fa74a98c-d6f5-4ce5-8a5f-343dc7372e76,network=Network(b0b7ae8f-a3e5-4e3f-a2f9-d38a05f3e988),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa74a98c-d6')
Oct 23 15:46:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Deleting instance files /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72_del
Oct 23 15:46:18 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Deletion of /opt/stack/data/nova/instances/b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72_del complete
Oct 23 15:46:18 user nova-compute[74421]: INFO nova.compute.manager [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 23 15:46:18 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:46:18 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Took 0.49 seconds to deallocate network for instance.
Oct 23 15:46:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-e855c282-8fac-4be3-bebb-562d1c53a531 req-bbf9007e-f8c0-4493-be5a-0de8d7a218fe service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-deleted-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:46:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:18 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Deleted allocations for instance b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72
Oct 23 15:46:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-d198163f-e36e-4b9e-80e6-dad154cf6502 tempest-ServerRescueNegativeTestJSON-1858635885 tempest-ServerRescueNegativeTestJSON-1858635885-project-member] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-bf25be45-b5a7-4ea1-acc7-b1d2eadce264 req-ae06c5b6-2380-4a92-8a25-48aa80a1dbf2 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bf25be45-b5a7-4ea1-acc7-b1d2eadce264 req-ae06c5b6-2380-4a92-8a25-48aa80a1dbf2 service nova] Acquiring lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bf25be45-b5a7-4ea1-acc7-b1d2eadce264 req-ae06c5b6-2380-4a92-8a25-48aa80a1dbf2 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bf25be45-b5a7-4ea1-acc7-b1d2eadce264 req-ae06c5b6-2380-4a92-8a25-48aa80a1dbf2 service nova] Lock "b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-bf25be45-b5a7-4ea1-acc7-b1d2eadce264 req-ae06c5b6-2380-4a92-8a25-48aa80a1dbf2 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] No waiting events found dispatching network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:46:19 user nova-compute[74421]: WARNING nova.compute.manager [req-bf25be45-b5a7-4ea1-acc7-b1d2eadce264 req-ae06c5b6-2380-4a92-8a25-48aa80a1dbf2 service nova] [instance: b1f687f3-f6f6-4ec0-9a47-ad33d2fefb72] Received unexpected event network-vif-plugged-fa74a98c-d6f5-4ce5-8a5f-343dc7372e76 for instance with vm_state deleted and task_state None.
Oct 23 15:46:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG nova.objects.instance [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'flavor' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:27 user nova-compute[74421]: INFO nova.compute.manager [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Attaching volume 5fa6a9a6-068c-43f9-8349-4936d0b82135 to /dev/vdb
Oct 23 15:46:27 user nova-compute[74421]: DEBUG os_brick.utils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a25931-6a55-42fe-969a-a5485237719e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ad5a6-d755-436f-b306-360b746d23ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9fda3-c6c5-4440-887d-f6c8496320e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bab742-b939-49e1-9c15-438e9ef493bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:46:27 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:46:27 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08161b0-9eb0-4b0b-b513-8b7cac3d0ce2]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:46:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:46:28 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:46:28 user nova-compute[74421]: DEBUG os_brick.utils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:46:28 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating existing volume attachment record: c9144f8e-894f-4617-a122-4a82a35f0f1d {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:46:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:34 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d937f218-8349-4e47-a8da-5cea5d6d70a5 is timed out.
Oct 23 15:46:34 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully detached device vdb from instance d937f218-8349-4e47-a8da-5cea5d6d70a5 from the live domain config.
Oct 23 15:46:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfqvXPHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:46:34 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c915674-5fef-463a-8961-2814057f8dab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:46:34 user nova-compute[74421]: No targets found.
Oct 23 15:46:34 user nova-compute[74421]: iSNS:
Oct 23 15:46:34 user nova-compute[74421]: No targets found.
Oct 23 15:46:34 user nova-compute[74421]: STATIC:
Oct 23 15:46:34 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd
Oct 23 15:46:34 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:46:34 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:46:34 user nova-compute[74421]: FIRMWARE:
Oct 23 15:46:34 user nova-compute[74421]: No targets found.
Oct 23 15:46:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:46:34 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:46:34 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8cb0cb-6592-411d-949e-005379f79d54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[219357b8-198a-493f-a2ee-e385c03a3f9d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd (non-flash)
Oct 23 15:46:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd (non-flash)
Oct 23 15:46:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478337640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6008a961-14f0-4158-b4b2-c5dec1653b7c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c119a-b9c8-4b87-9bf6-ffc971c80706]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10528fd-93dc-413b-8040-153fa79decb5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ddeac-6925-43af-8cce-7ed06d36bbab]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b630b27-44c9-48ef-83d6-6c7c2861918e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24288a6f-795b-4c0b-8f29-8931bc008081]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260]
Oct 23 15:46:34 user nova-compute[74421]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd, portal: 172.16.0.220,3260] successful.
Oct 23 15:46:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dade47-b083-48cf-98f0-67450203df59]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== disconnect_volume: return (292ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:46:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:46:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'flavor' on Instance uuid d937f218-8349-4e47-a8da-5cea5d6d70a5 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a4104f62-6807-4cec-9a70-6ed03527d272 tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.718s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 31.590s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:45 user nova-compute[74421]: INFO nova.compute.manager [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Terminating instance
Oct 23 15:46:45 user nova-compute[74421]: DEBUG nova.compute.manager [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:46:45 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:46:45 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:46:45 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5c05df-1c72-498b-9671-7423cd47df53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:46:45 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f004759-92de-4703-a185-7ffd05164c84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135] added
Oct 23 15:46:45 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e67d32-5fb6-4d9c-90c2-199b0b7c5cc1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b87b6-26a6-494a-bdb0-5ba283cfcd50]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfhZIDTs {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfhZIDTs" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[11901e06-1c84-4752-9b5a-f392e2f9524d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfhZIDTs'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e773b031-8fcc-4ea9-8ada-e3a53e77914c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[41216ffe-d0db-44c6-a9f1-d3679dede2c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:46:45 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:46:45 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:46:45 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 15:46:45 user nova-compute[74421]: 
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-1d79f822-c211-4a0f-b89d-970c67e99df9 req-f6433532-b495-4e7d-808b-88d43154ea8e service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-vif-unplugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1d79f822-c211-4a0f-b89d-970c67e99df9 req-f6433532-b495-4e7d-808b-88d43154ea8e service nova] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1d79f822-c211-4a0f-b89d-970c67e99df9 req-f6433532-b495-4e7d-808b-88d43154ea8e service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1d79f822-c211-4a0f-b89d-970c67e99df9 req-f6433532-b495-4e7d-808b-88d43154ea8e service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-1d79f822-c211-4a0f-b89d-970c67e99df9 req-f6433532-b495-4e7d-808b-88d43154ea8e service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] No waiting events found dispatching network-vif-unplugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG nova.compute.manager [req-1d79f822-c211-4a0f-b89d-970c67e99df9 req-f6433532-b495-4e7d-808b-88d43154ea8e service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-vif-unplugged-c4315ece-59ee-4bc5-af08-8490573ba593 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5e6b3-daa9-48fa-a7b6-23250d887e72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]
Oct 23 15:46:45 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.
Oct 23 15:46:45 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:45 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a664aeca-7dbc-4a07-8110-fb1d8ed4d2b2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64f9a3-a54f-4a08-8136-726e4fa7f46d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:46:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:46:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7c28b-743a-4fd6-91f6-a8641d2edecf]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:46:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Instance destroyed successfully.
Oct 23 15:46:46 user nova-compute[74421]: DEBUG nova.objects.instance [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lazy-loading 'resources' on Instance uuid d937f218-8349-4e47-a8da-5cea5d6d70a5 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1605006937',display_name='tempest-VolumesSnapshotTestJSON-instance-1605006937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1605006937',id=39,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRE1NHM1wEcDUogm+UQMmqnrhrgjre2VsiCR6BLqvESqum1x50Cy7ibkFSmB3gfcxHYaDGtKoaq39LhbNe08O/MgWiq77LpfvU7X/Yl/kNp5ccZytKxCHmvMSAutay9rg==',key_name='tempest-keypair-398532734',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e4434fbc6814bbb9fe2c48ed84f4a38',ramdisk_id='',reservation_id='r-q67bohrq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-461344925',owner_user_name='tempest-VolumesSnapshotTestJSON-461344925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:43:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f04beb9793444f0a92dcad598ce6533',uuid=d937f218-8349-4e47-a8da-5cea5d6d70a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converting VIF {"id": "c4315ece-59ee-4bc5-af08-8490573ba593", "address": "fa:16:3e:f9:8b:c7", "network": {"id": "dff5dd95-9689-4bc5-86af-615af28499dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655882840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4434fbc6814bbb9fe2c48ed84f4a38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4315ece-59", "ovs_interfaceid": "c4315ece-59ee-4bc5-af08-8490573ba593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_vif [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4315ece-59, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3632166-09ac-4a7d-b01a-f2cf4ecc6869) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:46 user nova-compute[74421]: INFO os_vif [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:8b:c7,bridge_name='br-int',has_traffic_filtering=True,id=c4315ece-59ee-4bc5-af08-8490573ba593,network=Network(dff5dd95-9689-4bc5-86af-615af28499dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4315ece-59')
Oct 23 15:46:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfqvXPHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:46:46 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:46:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23537313534653435', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537313534653435', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.609s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.objects.instance [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'flavor' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f81787d-1bf4-4058-a11a-d5dba8cfbf0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:46:47 user nova-compute[74421]: No targets found.
Oct 23 15:46:47 user nova-compute[74421]: iSNS:
Oct 23 15:46:47 user nova-compute[74421]: No targets found.
Oct 23 15:46:47 user nova-compute[74421]: STATIC:
Oct 23 15:46:47 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135
Oct 23 15:46:47 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:46:47 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:46:47 user nova-compute[74421]: FIRMWARE:
Oct 23 15:46:47 user nova-compute[74421]: No targets found.
Oct 23 15:46:47 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:46:47 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:46:47 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4db684f-adfa-4e52-8066-bdd986b0a5fd', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c63df7-0143-4371-b71c-bb7b6425a802]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:46:47 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:46:47 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:46:47 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:46:47 user nova-compute[74421]:   <serial>5fa6a9a6-068c-43f9-8349-4936d0b82135</serial>
Oct 23 15:46:47 user nova-compute[74421]: </disk>
Oct 23 15:46:47 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a9556-a0aa-4dba-b49e-fbe3d7ce2683]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:46:47 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:46:47 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247857c1f0>, {}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Disconnecting from: [] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] <== disconnect_volume: return (687ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:46:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Deleting instance files /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5_del
Oct 23 15:46:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Deletion of /opt/stack/data/nova/instances/d937f218-8349-4e47-a8da-5cea5d6d70a5_del complete
Oct 23 15:46:47 user nova-compute[74421]: INFO nova.compute.manager [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Took 1.57 seconds to destroy the instance on the hypervisor.
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No VIF found with MAC fa:16:3e:43:ed:0d, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2eb0bcbc-f1e4-4d4f-b3f3-b5b72a5c89c1 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.862s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-52490fba-3d2b-43e3-a8a2-a99c129e46f2 req-fe50c32d-0d57-4e71-80d0-53c5b1219acc service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52490fba-3d2b-43e3-a8a2-a99c129e46f2 req-fe50c32d-0d57-4e71-80d0-53c5b1219acc service nova] Acquiring lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52490fba-3d2b-43e3-a8a2-a99c129e46f2 req-fe50c32d-0d57-4e71-80d0-53c5b1219acc service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-52490fba-3d2b-43e3-a8a2-a99c129e46f2 req-fe50c32d-0d57-4e71-80d0-53c5b1219acc service nova] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:47 user nova-compute[74421]: DEBUG nova.compute.manager [req-52490fba-3d2b-43e3-a8a2-a99c129e46f2 req-fe50c32d-0d57-4e71-80d0-53c5b1219acc service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] No waiting events found dispatching network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:46:47 user nova-compute[74421]: WARNING nova.compute.manager [req-52490fba-3d2b-43e3-a8a2-a99c129e46f2 req-fe50c32d-0d57-4e71-80d0-53c5b1219acc service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received unexpected event network-vif-plugged-c4315ece-59ee-4bc5-af08-8490573ba593 for instance with vm_state active and task_state deleting.
Oct 23 15:46:48 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:46:48 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Took 0.91 seconds to deallocate network for instance.
Oct 23 15:46:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-35b8ddc4-e0f9-4305-8705-29303a7d7737 req-24ddb690-0f4b-40c7-a6d2-0b1129c9d64a service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Received event network-vif-deleted-c4315ece-59ee-4bc5-af08-8490573ba593 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:48 user nova-compute[74421]: INFO nova.compute.manager [req-35b8ddc4-e0f9-4305-8705-29303a7d7737 req-24ddb690-0f4b-40c7-a6d2-0b1129c9d64a service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Neutron deleted interface c4315ece-59ee-4bc5-af08-8490573ba593; detaching it from the instance and deleting it from the info cache
Oct 23 15:46:48 user nova-compute[74421]: DEBUG nova.network.neutron [req-35b8ddc4-e0f9-4305-8705-29303a7d7737 req-24ddb690-0f4b-40c7-a6d2-0b1129c9d64a service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:46:48 user nova-compute[74421]: DEBUG nova.compute.manager [req-35b8ddc4-e0f9-4305-8705-29303a7d7737 req-24ddb690-0f4b-40c7-a6d2-0b1129c9d64a service nova] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Detach interface failed, port_id=c4315ece-59ee-4bc5-af08-8490573ba593, reason: Instance d937f218-8349-4e47-a8da-5cea5d6d70a5 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:46:48 user nova-compute[74421]: WARNING nova.volume.cinder [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Attachment 07a74fd8-bf78-4598-b5cc-4012ee0ee6c5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 07a74fd8-bf78-4598-b5cc-4012ee0ee6c5. (HTTP 404) (Request-ID: req-3cf0c8aa-87a6-4821-9b90-00a1960725e0)
Oct 23 15:46:48 user nova-compute[74421]: INFO nova.compute.manager [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] [instance: d937f218-8349-4e47-a8da-5cea5d6d70a5] Took 0.04 seconds to detach 1 volumes for instance.
Oct 23 15:46:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:48 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:46:48 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:46:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:48 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Deleted allocations for instance d937f218-8349-4e47-a8da-5cea5d6d70a5
Oct 23 15:46:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e5-3180-44ad-a86f-3754a79e932a tempest-VolumesSnapshotTestJSON-461344925 tempest-VolumesSnapshotTestJSON-461344925-project-member] Lock "d937f218-8349-4e47-a8da-5cea5d6d70a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:50 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:46:50 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:46:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:46:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:46:57 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:46:57 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.074413299560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fd38a03f-899c-440f-b9a4-3311884941c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:46:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-changed-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing instance network info cache due to event network-changed-37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updated VIF entry in instance network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG nova.network.neutron [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:46:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f429a61c-7fcc-437b-9182-cf914339995c req-a2486efa-96ef-4960-8db1-38898ff852c5 service nova] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:47:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-changed-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing instance network info cache due to event network-changed-37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG nova.network.neutron [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG nova.network.neutron [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updated VIF entry in instance network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG nova.network.neutron [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:47:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8d5b606d-ba96-4348-ad6c-ea18d0dd7cb5 req-0d9056f1-d8ad-42b0-bde9-fbc35c425a3c service nova] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:47:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:47:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:11 user nova-compute[74421]: INFO nova.compute.manager [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Rebooting instance
Oct 23 15:47:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:47:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:47:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ee1d9be-4344-484a-bed0-ba988a0df1b5 req-13dd5974-7f1a-4446-9efd-b3e3bccea130 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-unplugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ee1d9be-4344-484a-bed0-ba988a0df1b5 req-13dd5974-7f1a-4446-9efd-b3e3bccea130 service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ee1d9be-4344-484a-bed0-ba988a0df1b5 req-13dd5974-7f1a-4446-9efd-b3e3bccea130 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3ee1d9be-4344-484a-bed0-ba988a0df1b5 req-13dd5974-7f1a-4446-9efd-b3e3bccea130 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-3ee1d9be-4344-484a-bed0-ba988a0df1b5 req-13dd5974-7f1a-4446-9efd-b3e3bccea130 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-unplugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:47:12 user nova-compute[74421]: WARNING nova.compute.manager [req-3ee1d9be-4344-484a-bed0-ba988a0df1b5 req-13dd5974-7f1a-4446-9efd-b3e3bccea130 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-unplugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:13 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance destroyed successfully.
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'resources' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-690149044',display_name='tempest-TestMinimumBasicScenario-server-690149044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-690149044',id=40,image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVrF6qY32TP+U8xhcaM85ZRVobVNM9KWn0MAOa0iFqRENM4CzxRwRVyVl4Q33cN97Dbd0TCutwWn09XIFcGfTwv8Xv8LwjulpM5xzb24oLw07DAlcM99yCzGfLG0QAC9Q==',key_name='tempest-TestMinimumBasicScenario-966738554',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-0zcaq5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:47:12Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=fd38a03f-899c-440f-b9a4-3311884941c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37875513-43, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bab6f6b-596d-4ecc-9361-d97157d6eb99) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:13 user nova-compute[74421]: INFO os_vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43')
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:47:13 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0b8fd3-9aa8-4543-9cd7-aaa088fee488]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:47:13 user nova-compute[74421]: No targets found.
Oct 23 15:47:13 user nova-compute[74421]: iSNS:
Oct 23 15:47:13 user nova-compute[74421]: No targets found.
Oct 23 15:47:13 user nova-compute[74421]: STATIC:
Oct 23 15:47:13 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135
Oct 23 15:47:13 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:47:13 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:47:13 user nova-compute[74421]: FIRMWARE:
Oct 23 15:47:13 user nova-compute[74421]: No targets found.
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:47:13 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:47:13 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd9052-8f3a-4cd5-b231-68063d1d0f8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4186117e-076f-4d39-895d-ef18bc143ce7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782a6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[354f80c2-de65-4dc7-984f-04b5c55ca852]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32e84c-bacf-4b6b-9d18-42a8ba23b012]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc9e134-84fa-4062-bcc6-92d1917774f6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf93e6-c376-407b-9973-815cdc75e3a8]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[32868224-88c4-43a3-9f05-4107b813a8fd]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa11cce-4022-4290-a410-fb8941660c1a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]
Oct 23 15:47:13 user nova-compute[74421]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25dbae4-455d-4aed-a7d9-1197737bb7be]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== disconnect_volume: return (304ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Start _get_guest_xml network_info=[{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=578f8aba-8ffe-4510-ad09-e6a6a2942eba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '578f8aba-8ffe-4510-ad09-e6a6a2942eba'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'c9144f8e-894f-4617-a122-4a82a35f0f1d', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fd38a03f-899c-440f-b9a4-3311884941c3', 'attached_at': '', 'detached_at': '', 'volume_id': '5fa6a9a6-068c-43f9-8349-4936d0b82135', 'serial': '5fa6a9a6-068c-43f9-8349-4936d0b82135'}, 'boot_index': None, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:47:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:47:13 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=578f8aba-8ffe-4510-ad09-e6a6a2942eba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.objects.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Object Instance<fd38a03f-899c-440f-b9a4-3311884941c3> lazy-loaded attributes: resources,vcpu_model {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:47:13 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:47:13 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:47:13 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286389d-71c0-4191-9078-8b3039a96fae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:47:13 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0867fde3-2d67-4414-9b3b-3dad11cd11e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135] added
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab760d-af97-4e4e-946a-dd11c09b3574]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb107c96-1db0-443e-95bd-2f0302f8084b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfhZIDTs {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfhZIDTs" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d7c32-da87-4ccc-b41f-44eda59a6b17]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfhZIDTs'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b25bb8-dd83-4cad-8780-8e38ac2b1478]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ca6b5-1b6e-447e-923c-19eabc5a760c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:47:13 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:47:13 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:47:13 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 15:47:13 user nova-compute[74421]: 
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b36829-8a59-4799-9f4f-93f38a139f16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]
Oct 23 15:47:13 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db8e7b9-4179-4a00-ab4b-d1be2f6abf37]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0fac42-c090-463e-8472-383d04f1dfb5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:47:13 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:47:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33030b2-e1d3-4d16-9be4-cd7709574e35]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-dfd25969-109a-4099-80d3-a5bd35603a73 req-26ea75f4-441f-4ee4-806c-2393d8c95a29 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dfd25969-109a-4099-80d3-a5bd35603a73 req-26ea75f4-441f-4ee4-806c-2393d8c95a29 service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dfd25969-109a-4099-80d3-a5bd35603a73 req-26ea75f4-441f-4ee4-806c-2393d8c95a29 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dfd25969-109a-4099-80d3-a5bd35603a73 req-26ea75f4-441f-4ee4-806c-2393d8c95a29 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:14 user nova-compute[74421]: DEBUG nova.compute.manager [req-dfd25969-109a-4099-80d3-a5bd35603a73 req-26ea75f4-441f-4ee4-806c-2393d8c95a29 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:47:14 user nova-compute[74421]: WARNING nova.compute.manager [req-dfd25969-109a-4099-80d3-a5bd35603a73 req-26ea75f4-441f-4ee4-806c-2393d8c95a29 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 15:47:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23537313534653435', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537313534653435', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-690149044',display_name='tempest-TestMinimumBasicScenario-server-690149044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-690149044',id=40,image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVrF6qY32TP+U8xhcaM85ZRVobVNM9KWn0MAOa0iFqRENM4CzxRwRVyVl4Q33cN97Dbd0TCutwWn09XIFcGfTwv8Xv8LwjulpM5xzb24oLw07DAlcM99yCzGfLG0QAC9Q==',key_name='tempest-TestMinimumBasicScenario-966738554',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-0zcaq5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:47:12Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=fd38a03f-899c-440f-b9a4-3311884941c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'pci_devices' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.objects.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Object Instance<fd38a03f-899c-440f-b9a4-3311884941c3> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:47:15 user nova-compute[74421]:   <uuid>fd38a03f-899c-440f-b9a4-3311884941c3</uuid>
Oct 23 15:47:15 user nova-compute[74421]:   <name>instance-00000028</name>
Oct 23 15:47:15 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:47:15 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:47:15 user nova-compute[74421]:   <metadata>
Oct 23 15:47:15 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:47:15 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:47:15 user nova-compute[74421]:       <nova:name>tempest-TestMinimumBasicScenario-server-690149044</nova:name>
Oct 23 15:47:15 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:47:13</nova:creationTime>
Oct 23 15:47:15 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:47:15 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:47:15 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:47:15 user nova-compute[74421]:       <nova:owner>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:user uuid="ae006290eb4d49609eee46250660adb8">tempest-TestMinimumBasicScenario-1824567034-project-member</nova:user>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:project uuid="88f3c0fda43d4b42a16478be0d47270b">tempest-TestMinimumBasicScenario-1824567034</nova:project>
Oct 23 15:47:15 user nova-compute[74421]:       </nova:owner>
Oct 23 15:47:15 user nova-compute[74421]:       <nova:root type="image" uuid="578f8aba-8ffe-4510-ad09-e6a6a2942eba"/>
Oct 23 15:47:15 user nova-compute[74421]:       <nova:ports>
Oct 23 15:47:15 user nova-compute[74421]:         <nova:port uuid="37875513-43bb-490a-bddf-7b8523dc998e">
Oct 23 15:47:15 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 15:47:15 user nova-compute[74421]:         </nova:port>
Oct 23 15:47:15 user nova-compute[74421]:       </nova:ports>
Oct 23 15:47:15 user nova-compute[74421]:     </nova:instance>
Oct 23 15:47:15 user nova-compute[74421]:   </metadata>
Oct 23 15:47:15 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:47:15 user nova-compute[74421]:     <system>
Oct 23 15:47:15 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:47:15 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:47:15 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:47:15 user nova-compute[74421]:       <entry name="serial">fd38a03f-899c-440f-b9a4-3311884941c3</entry>
Oct 23 15:47:15 user nova-compute[74421]:       <entry name="uuid">fd38a03f-899c-440f-b9a4-3311884941c3</entry>
Oct 23 15:47:15 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:47:15 user nova-compute[74421]:     </system>
Oct 23 15:47:15 user nova-compute[74421]:   </sysinfo>
Oct 23 15:47:15 user nova-compute[74421]:   <os>
Oct 23 15:47:15 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:47:15 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:47:15 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:47:15 user nova-compute[74421]:   </os>
Oct 23 15:47:15 user nova-compute[74421]:   <features>
Oct 23 15:47:15 user nova-compute[74421]:     <acpi/>
Oct 23 15:47:15 user nova-compute[74421]:     <apic/>
Oct 23 15:47:15 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:47:15 user nova-compute[74421]:   </features>
Oct 23 15:47:15 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:47:15 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:47:15 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:47:15 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:47:15 user nova-compute[74421]:   </clock>
Oct 23 15:47:15 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:47:15 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:47:15 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:47:15 user nova-compute[74421]:   </cpu>
Oct 23 15:47:15 user nova-compute[74421]:   <devices>
Oct 23 15:47:15 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:47:15 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:47:15 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk"/>
Oct 23 15:47:15 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:47:15 user nova-compute[74421]:     </disk>
Oct 23 15:47:15 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:47:15 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:47:15 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:47:15 user nova-compute[74421]:       <target dev="vdb" bus="virtio"/>
Oct 23 15:47:15 user nova-compute[74421]:       <serial>5fa6a9a6-068c-43f9-8349-4936d0b82135</serial>
Oct 23 15:47:15 user nova-compute[74421]:     </disk>
Oct 23 15:47:15 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:47:15 user nova-compute[74421]:       <mac address="fa:16:3e:43:ed:0d"/>
Oct 23 15:47:15 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:47:15 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:47:15 user nova-compute[74421]:       <target dev="tap37875513-43"/>
Oct 23 15:47:15 user nova-compute[74421]:     </interface>
Oct 23 15:47:15 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:47:15 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/console.log" append="off"/>
Oct 23 15:47:15 user nova-compute[74421]:     </serial>
Oct 23 15:47:15 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:47:15 user nova-compute[74421]:     <video>
Oct 23 15:47:15 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:47:15 user nova-compute[74421]:     </video>
Oct 23 15:47:15 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:47:15 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:47:15 user nova-compute[74421]:     </rng>
Oct 23 15:47:15 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:47:15 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:47:15 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:47:15 user nova-compute[74421]:     </memballoon>
Oct 23 15:47:15 user nova-compute[74421]:   </devices>
Oct 23 15:47:15 user nova-compute[74421]: </domain>
Oct 23 15:47:15 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.objects.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Object Instance<fd38a03f-899c-440f-b9a4-3311884941c3> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Cannot resize image /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'migration_context' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.objects.base [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Object Instance<fd38a03f-899c-440f-b9a4-3311884941c3> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74421) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-690149044',display_name='tempest-TestMinimumBasicScenario-server-690149044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-690149044',id=40,image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVrF6qY32TP+U8xhcaM85ZRVobVNM9KWn0MAOa0iFqRENM4CzxRwRVyVl4Q33cN97Dbd0TCutwWn09XIFcGfTwv8Xv8LwjulpM5xzb24oLw07DAlcM99yCzGfLG0QAC9Q==',key_name='tempest-TestMinimumBasicScenario-966738554',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-0zcaq5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:47:12Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=fd38a03f-899c-440f-b9a4-3311884941c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG os_vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b1434d-4165-521b-992c-5b066efb5a11', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37875513-43, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37875513-43, col_values=(('qos', UUID('4d435929-320e-409a-8c45-b78395a1ac22')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37875513-43, col_values=(('external_ids', {'iface-id': '37875513-43bb-490a-bddf-7b8523dc998e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ed:0d', 'vm-uuid': 'fd38a03f-899c-440f-b9a4-3311884941c3'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:47:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:15 user nova-compute[74421]: INFO os_vif [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43')
Oct 23 15:47:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-732290ba-b9e0-46ce-8b3d-5a4e89ae594e req-56c68e31-cfa8-4cee-b776-0c5d3efe4cdc service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-732290ba-b9e0-46ce-8b3d-5a4e89ae594e req-56c68e31-cfa8-4cee-b776-0c5d3efe4cdc service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-732290ba-b9e0-46ce-8b3d-5a4e89ae594e req-56c68e31-cfa8-4cee-b776-0c5d3efe4cdc service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-732290ba-b9e0-46ce-8b3d-5a4e89ae594e req-56c68e31-cfa8-4cee-b776-0c5d3efe4cdc service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG nova.compute.manager [req-732290ba-b9e0-46ce-8b3d-5a4e89ae594e req-56c68e31-cfa8-4cee-b776-0c5d3efe4cdc service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:47:17 user nova-compute[74421]: WARNING nova.compute.manager [req-732290ba-b9e0-46ce-8b3d-5a4e89ae594e req-56c68e31-cfa8-4cee-b776-0c5d3efe4cdc service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 15:47:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-7fd53393-0a5e-497f-8745-83a19d8079b8 req-001993f6-ead3-4316-b3eb-f8dcec532e50 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7fd53393-0a5e-497f-8745-83a19d8079b8 req-001993f6-ead3-4316-b3eb-f8dcec532e50 service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7fd53393-0a5e-497f-8745-83a19d8079b8 req-001993f6-ead3-4316-b3eb-f8dcec532e50 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7fd53393-0a5e-497f-8745-83a19d8079b8 req-001993f6-ead3-4316-b3eb-f8dcec532e50 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:19 user nova-compute[74421]: DEBUG nova.compute.manager [req-7fd53393-0a5e-497f-8745-83a19d8079b8 req-001993f6-ead3-4316-b3eb-f8dcec532e50 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:47:19 user nova-compute[74421]: WARNING nova.compute.manager [req-7fd53393-0a5e-497f-8745-83a19d8079b8 req-001993f6-ead3-4316-b3eb-f8dcec532e50 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 15:47:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:47:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance rebooted successfully.
Oct 23 15:47:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:47:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8d510a36-0e7b-41ff-8d98-62d14e37f5c6 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.929s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:47:21 user nova-compute[74421]: INFO nova.compute.claims [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Claim successful on node user
Oct 23 15:47:21 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:47:21 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:47:22 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.policy [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9af9227b4e74b97a2ee0b2aca32e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c934c4c4f0304483809e410717e63030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:47:22 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Creating image(s)
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "/opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "/opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "/opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.225s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.286s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk 1073741824" returned: 0 in 0.057s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Successfully created port: e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.213s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Cannot resize image /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Ensure instance console log exists: /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Successfully updated port: e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquired lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-changed-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.compute.manager [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Refreshing instance network info cache due to event network-changed-e6c1d886-be17-4cea-937b-cf12ed229cb9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] Acquiring lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:47:23 user nova-compute[74421]: DEBUG nova.network.neutron [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.neutron [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Releasing lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Instance network_info: |[{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] Acquired lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Refreshing network info cache for port e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Start _get_guest_xml network_info=[{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:47:24 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:47:24 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1480907857',display_name='tempest-AttachVolumeTestJSON-server-1480907857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1480907857',id=41,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhNGEMbJuySVkH62ikVdQ1HgAqXYwZVQqJGHaQKXN3tbNJtq2g7hcG3TnFMhecgkdrPaKhvpgPhL2+ybH+RyIPRMkVgF/nQKizAUBudxpENLQAuD+hQjkVqLXfmrW7KUg==',key_name='tempest-keypair-2137116288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c934c4c4f0304483809e410717e63030',ramdisk_id='',reservation_id='r-1eqpc4fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-532911348',owner_user_name='tempest-AttachVolumeTestJSON-532911348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9af9227b4e74b97a2ee0b2aca32e74e',uuid=d65e6022-8249-4185-b4c1-96ad8a86a6f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converting VIF {"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.objects.instance [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'pci_devices' on Instance uuid d65e6022-8249-4185-b4c1-96ad8a86a6f2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:47:24 user nova-compute[74421]:   <uuid>d65e6022-8249-4185-b4c1-96ad8a86a6f2</uuid>
Oct 23 15:47:24 user nova-compute[74421]:   <name>instance-00000029</name>
Oct 23 15:47:24 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:47:24 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:47:24 user nova-compute[74421]:   <metadata>
Oct 23 15:47:24 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:47:24 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:47:24 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeTestJSON-server-1480907857</nova:name>
Oct 23 15:47:24 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:47:24</nova:creationTime>
Oct 23 15:47:24 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:47:24 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:47:24 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:47:24 user nova-compute[74421]:       <nova:owner>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:user uuid="d9af9227b4e74b97a2ee0b2aca32e74e">tempest-AttachVolumeTestJSON-532911348-project-member</nova:user>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:project uuid="c934c4c4f0304483809e410717e63030">tempest-AttachVolumeTestJSON-532911348</nova:project>
Oct 23 15:47:24 user nova-compute[74421]:       </nova:owner>
Oct 23 15:47:24 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:47:24 user nova-compute[74421]:       <nova:ports>
Oct 23 15:47:24 user nova-compute[74421]:         <nova:port uuid="e6c1d886-be17-4cea-937b-cf12ed229cb9">
Oct 23 15:47:24 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 15:47:24 user nova-compute[74421]:         </nova:port>
Oct 23 15:47:24 user nova-compute[74421]:       </nova:ports>
Oct 23 15:47:24 user nova-compute[74421]:     </nova:instance>
Oct 23 15:47:24 user nova-compute[74421]:   </metadata>
Oct 23 15:47:24 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:47:24 user nova-compute[74421]:     <system>
Oct 23 15:47:24 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:47:24 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:47:24 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:47:24 user nova-compute[74421]:       <entry name="serial">d65e6022-8249-4185-b4c1-96ad8a86a6f2</entry>
Oct 23 15:47:24 user nova-compute[74421]:       <entry name="uuid">d65e6022-8249-4185-b4c1-96ad8a86a6f2</entry>
Oct 23 15:47:24 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:47:24 user nova-compute[74421]:     </system>
Oct 23 15:47:24 user nova-compute[74421]:   </sysinfo>
Oct 23 15:47:24 user nova-compute[74421]:   <os>
Oct 23 15:47:24 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:47:24 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:47:24 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:47:24 user nova-compute[74421]:   </os>
Oct 23 15:47:24 user nova-compute[74421]:   <features>
Oct 23 15:47:24 user nova-compute[74421]:     <acpi/>
Oct 23 15:47:24 user nova-compute[74421]:     <apic/>
Oct 23 15:47:24 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:47:24 user nova-compute[74421]:   </features>
Oct 23 15:47:24 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:47:24 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:47:24 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:47:24 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:47:24 user nova-compute[74421]:   </clock>
Oct 23 15:47:24 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:47:24 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:47:24 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:47:24 user nova-compute[74421]:   </cpu>
Oct 23 15:47:24 user nova-compute[74421]:   <devices>
Oct 23 15:47:24 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:47:24 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:47:24 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk"/>
Oct 23 15:47:24 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:47:24 user nova-compute[74421]:     </disk>
Oct 23 15:47:24 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:47:24 user nova-compute[74421]:       <mac address="fa:16:3e:7d:5a:90"/>
Oct 23 15:47:24 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:47:24 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:47:24 user nova-compute[74421]:       <target dev="tape6c1d886-be"/>
Oct 23 15:47:24 user nova-compute[74421]:     </interface>
Oct 23 15:47:24 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:47:24 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/console.log" append="off"/>
Oct 23 15:47:24 user nova-compute[74421]:     </serial>
Oct 23 15:47:24 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:47:24 user nova-compute[74421]:     <video>
Oct 23 15:47:24 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:47:24 user nova-compute[74421]:     </video>
Oct 23 15:47:24 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:47:24 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:47:24 user nova-compute[74421]:     </rng>
Oct 23 15:47:24 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:47:24 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:47:24 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:47:24 user nova-compute[74421]:     </memballoon>
Oct 23 15:47:24 user nova-compute[74421]:   </devices>
Oct 23 15:47:24 user nova-compute[74421]: </domain>
Oct 23 15:47:24 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1480907857',display_name='tempest-AttachVolumeTestJSON-server-1480907857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1480907857',id=41,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhNGEMbJuySVkH62ikVdQ1HgAqXYwZVQqJGHaQKXN3tbNJtq2g7hcG3TnFMhecgkdrPaKhvpgPhL2+ybH+RyIPRMkVgF/nQKizAUBudxpENLQAuD+hQjkVqLXfmrW7KUg==',key_name='tempest-keypair-2137116288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c934c4c4f0304483809e410717e63030',ramdisk_id='',reservation_id='r-1eqpc4fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-532911348',owner_user_name='tempest-AttachVolumeTestJSON-532911348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9af9227b4e74b97a2ee0b2aca32e74e',uuid=d65e6022-8249-4185-b4c1-96ad8a86a6f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converting VIF {"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG os_vif [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f15c16df-617f-5334-82b8-baf3521838a4', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c1d886-be, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6c1d886-be, col_values=(('qos', UUID('248fa654-e40d-453b-aff3-081954d30fe6')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6c1d886-be, col_values=(('external_ids', {'iface-id': 'e6c1d886-be17-4cea-937b-cf12ed229cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:5a:90', 'vm-uuid': 'd65e6022-8249-4185-b4c1-96ad8a86a6f2'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:24 user nova-compute[74421]: INFO os_vif [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be')
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No VIF found with MAC fa:16:3e:7d:5a:90, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updated VIF entry in instance network info cache for port e6c1d886-be17-4cea-937b-cf12ed229cb9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:47:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-426b9e5f-7613-47e3-bc06-4aa847bc7c67 req-45e89760-622b-44c9-9724-e9ed774d48c2 service nova] Releasing lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:47:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-a05e234a-048c-44b4-a538-f65650a84338 req-69ff0f08-01e6-42b0-96de-b2ff62eb3479 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a05e234a-048c-44b4-a538-f65650a84338 req-69ff0f08-01e6-42b0-96de-b2ff62eb3479 service nova] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a05e234a-048c-44b4-a538-f65650a84338 req-69ff0f08-01e6-42b0-96de-b2ff62eb3479 service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a05e234a-048c-44b4-a538-f65650a84338 req-69ff0f08-01e6-42b0-96de-b2ff62eb3479 service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-a05e234a-048c-44b4-a538-f65650a84338 req-69ff0f08-01e6-42b0-96de-b2ff62eb3479 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] No waiting events found dispatching network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:47:26 user nova-compute[74421]: WARNING nova.compute.manager [req-a05e234a-048c-44b4-a538-f65650a84338 req-69ff0f08-01e6-42b0-96de-b2ff62eb3479 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received unexpected event network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 for instance with vm_state building and task_state spawning.
Oct 23 15:47:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:47:28 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Instance spawned successfully.
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-a6114988-13c2-4445-b297-aed504c9aa48 req-42bfee9a-d0c3-4708-82fe-a7f9e27f9b23 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a6114988-13c2-4445-b297-aed504c9aa48 req-42bfee9a-d0c3-4708-82fe-a7f9e27f9b23 service nova] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a6114988-13c2-4445-b297-aed504c9aa48 req-42bfee9a-d0c3-4708-82fe-a7f9e27f9b23 service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a6114988-13c2-4445-b297-aed504c9aa48 req-42bfee9a-d0c3-4708-82fe-a7f9e27f9b23 service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-a6114988-13c2-4445-b297-aed504c9aa48 req-42bfee9a-d0c3-4708-82fe-a7f9e27f9b23 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] No waiting events found dispatching network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:47:28 user nova-compute[74421]: WARNING nova.compute.manager [req-a6114988-13c2-4445-b297-aed504c9aa48 req-42bfee9a-d0c3-4708-82fe-a7f9e27f9b23 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received unexpected event network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 for instance with vm_state building and task_state spawning.
Oct 23 15:47:28 user nova-compute[74421]: INFO nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Took 6.04 seconds to spawn the instance on the hypervisor.
Oct 23 15:47:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:47:28 user nova-compute[74421]: INFO nova.compute.manager [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Took 6.71 seconds to build instance.
Oct 23 15:47:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-486fe9ac-f17b-4f63-8d71-b091ca83a8a5 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.838s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:48 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:47:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:47:51 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:47:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:47:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:47:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:47:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:47:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:47:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:47:59 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:47:59 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.03221893310547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fd38a03f-899c-440f-b9a4-3311884941c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d65e6022-8249-4185-b4c1-96ad8a86a6f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:47:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:01 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:48:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:48:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:48:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:48:20 user nova-compute[74421]: INFO nova.compute.claims [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Claim successful on node user
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:48:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.policy [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbea674c96a747fd9517812e6800a19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6441b3c331748b5b2203328b2595f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:48:20 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Creating image(s)
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "/opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "/opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "/opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.229s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk 1073741824" returned: 0 in 0.058s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Successfully created port: 97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Cannot resize image /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Ensure instance console log exists: /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Successfully updated port: 97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquired lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-changed-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.compute.manager [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Refreshing instance network info cache due to event network-changed-97268cc8-85ca-47ce-9384-305fc8089c35. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] Acquiring lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.neutron [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Releasing lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Instance network_info: |[{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] Acquired lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.neutron [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Refreshing network info cache for port 97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Start _get_guest_xml network_info=[{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:48:22 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:48:22 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1502763980',display_name='tempest-TestStampPattern-server-1502763980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1502763980',id=42,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDVqurofzLMZNAaghRQtpJ19oylFKFhcxcqMDmzqCiNpsP1f695EadLkKhqxpHR8kS2jYtqlGFt0+J9RecbAT98pcr/b42YIaDLq3lZwwq4BIP60C4+g0H7X1GAdN6Bw==',key_name='tempest-TestStampPattern-1526100776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6441b3c331748b5b2203328b2595f37',ramdisk_id='',reservation_id='r-4aesdme8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-320376849',owner_user_name='tempest-TestStampPattern-320376849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:48:21Z,user_data=None,user_id='dbea674c96a747fd9517812e6800a19f',uuid=358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converting VIF {"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.objects.instance [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'pci_devices' on Instance uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:48:22 user nova-compute[74421]:   <uuid>358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f</uuid>
Oct 23 15:48:22 user nova-compute[74421]:   <name>instance-0000002a</name>
Oct 23 15:48:22 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:48:22 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:48:22 user nova-compute[74421]:   <metadata>
Oct 23 15:48:22 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:48:22 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:48:22 user nova-compute[74421]:       <nova:name>tempest-TestStampPattern-server-1502763980</nova:name>
Oct 23 15:48:22 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:48:22</nova:creationTime>
Oct 23 15:48:22 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:48:22 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:48:22 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:48:22 user nova-compute[74421]:       <nova:owner>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:user uuid="dbea674c96a747fd9517812e6800a19f">tempest-TestStampPattern-320376849-project-member</nova:user>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:project uuid="f6441b3c331748b5b2203328b2595f37">tempest-TestStampPattern-320376849</nova:project>
Oct 23 15:48:22 user nova-compute[74421]:       </nova:owner>
Oct 23 15:48:22 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:48:22 user nova-compute[74421]:       <nova:ports>
Oct 23 15:48:22 user nova-compute[74421]:         <nova:port uuid="97268cc8-85ca-47ce-9384-305fc8089c35">
Oct 23 15:48:22 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 15:48:22 user nova-compute[74421]:         </nova:port>
Oct 23 15:48:22 user nova-compute[74421]:       </nova:ports>
Oct 23 15:48:22 user nova-compute[74421]:     </nova:instance>
Oct 23 15:48:22 user nova-compute[74421]:   </metadata>
Oct 23 15:48:22 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:48:22 user nova-compute[74421]:     <system>
Oct 23 15:48:22 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:48:22 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:48:22 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:48:22 user nova-compute[74421]:       <entry name="serial">358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f</entry>
Oct 23 15:48:22 user nova-compute[74421]:       <entry name="uuid">358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f</entry>
Oct 23 15:48:22 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:48:22 user nova-compute[74421]:     </system>
Oct 23 15:48:22 user nova-compute[74421]:   </sysinfo>
Oct 23 15:48:22 user nova-compute[74421]:   <os>
Oct 23 15:48:22 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:48:22 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:48:22 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:48:22 user nova-compute[74421]:   </os>
Oct 23 15:48:22 user nova-compute[74421]:   <features>
Oct 23 15:48:22 user nova-compute[74421]:     <acpi/>
Oct 23 15:48:22 user nova-compute[74421]:     <apic/>
Oct 23 15:48:22 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:48:22 user nova-compute[74421]:   </features>
Oct 23 15:48:22 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:48:22 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:48:22 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:48:22 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:48:22 user nova-compute[74421]:   </clock>
Oct 23 15:48:22 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:48:22 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:48:22 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:48:22 user nova-compute[74421]:   </cpu>
Oct 23 15:48:22 user nova-compute[74421]:   <devices>
Oct 23 15:48:22 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:48:22 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:48:22 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk"/>
Oct 23 15:48:22 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:48:22 user nova-compute[74421]:     </disk>
Oct 23 15:48:22 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:48:22 user nova-compute[74421]:       <mac address="fa:16:3e:22:53:55"/>
Oct 23 15:48:22 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:48:22 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:48:22 user nova-compute[74421]:       <target dev="tap97268cc8-85"/>
Oct 23 15:48:22 user nova-compute[74421]:     </interface>
Oct 23 15:48:22 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:48:22 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/console.log" append="off"/>
Oct 23 15:48:22 user nova-compute[74421]:     </serial>
Oct 23 15:48:22 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:48:22 user nova-compute[74421]:     <video>
Oct 23 15:48:22 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:48:22 user nova-compute[74421]:     </video>
Oct 23 15:48:22 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:48:22 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:48:22 user nova-compute[74421]:     </rng>
Oct 23 15:48:22 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:48:22 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:48:22 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:48:22 user nova-compute[74421]:     </memballoon>
Oct 23 15:48:22 user nova-compute[74421]:   </devices>
Oct 23 15:48:22 user nova-compute[74421]: </domain>
Oct 23 15:48:22 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1502763980',display_name='tempest-TestStampPattern-server-1502763980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1502763980',id=42,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDVqurofzLMZNAaghRQtpJ19oylFKFhcxcqMDmzqCiNpsP1f695EadLkKhqxpHR8kS2jYtqlGFt0+J9RecbAT98pcr/b42YIaDLq3lZwwq4BIP60C4+g0H7X1GAdN6Bw==',key_name='tempest-TestStampPattern-1526100776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6441b3c331748b5b2203328b2595f37',ramdisk_id='',reservation_id='r-4aesdme8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-320376849',owner_user_name='tempest-TestStampPattern-320376849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:48:21Z,user_data=None,user_id='dbea674c96a747fd9517812e6800a19f',uuid=358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converting VIF {"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG os_vif [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8ffff2c-3d0e-5afd-b192-ba6281f7b25b', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97268cc8-85, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97268cc8-85, col_values=(('qos', UUID('a7f26315-8b29-48b7-a655-adb33a84d7ed')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97268cc8-85, col_values=(('external_ids', {'iface-id': '97268cc8-85ca-47ce-9384-305fc8089c35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:53:55', 'vm-uuid': '358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:22 user nova-compute[74421]: INFO os_vif [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85')
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:48:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No VIF found with MAC fa:16:3e:22:53:55, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:48:23 user nova-compute[74421]: DEBUG nova.network.neutron [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updated VIF entry in instance network info cache for port 97268cc8-85ca-47ce-9384-305fc8089c35. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:48:23 user nova-compute[74421]: DEBUG nova.network.neutron [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:48:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9cdd1d41-6bbe-473a-a321-226941238546 req-a770ea50-5493-4114-b410-86e1456d143a service nova] Releasing lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-b01a6ace-9c86-4c7a-8550-27263e70ef06 req-e59ea0b3-c586-4787-8f14-6ecdd303f5d5 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b01a6ace-9c86-4c7a-8550-27263e70ef06 req-e59ea0b3-c586-4787-8f14-6ecdd303f5d5 service nova] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b01a6ace-9c86-4c7a-8550-27263e70ef06 req-e59ea0b3-c586-4787-8f14-6ecdd303f5d5 service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b01a6ace-9c86-4c7a-8550-27263e70ef06 req-e59ea0b3-c586-4787-8f14-6ecdd303f5d5 service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-b01a6ace-9c86-4c7a-8550-27263e70ef06 req-e59ea0b3-c586-4787-8f14-6ecdd303f5d5 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] No waiting events found dispatching network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:48:24 user nova-compute[74421]: WARNING nova.compute.manager [req-b01a6ace-9c86-4c7a-8550-27263e70ef06 req-e59ea0b3-c586-4787-8f14-6ecdd303f5d5 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received unexpected event network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 for instance with vm_state building and task_state spawning.
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:48:26 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Instance spawned successfully.
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:48:26 user nova-compute[74421]: INFO nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Took 5.32 seconds to spawn the instance on the hypervisor.
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:48:26 user nova-compute[74421]: INFO nova.compute.manager [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Took 5.95 seconds to build instance.
Oct 23 15:48:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-8f80a749-1755-4966-8a68-9e962b47da36 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.048s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-ef28081b-2bd6-401a-8030-c8862394a14d req-b2a58209-6af1-4c6b-b590-c68106d1a726 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ef28081b-2bd6-401a-8030-c8862394a14d req-b2a58209-6af1-4c6b-b590-c68106d1a726 service nova] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ef28081b-2bd6-401a-8030-c8862394a14d req-b2a58209-6af1-4c6b-b590-c68106d1a726 service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ef28081b-2bd6-401a-8030-c8862394a14d req-b2a58209-6af1-4c6b-b590-c68106d1a726 service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-ef28081b-2bd6-401a-8030-c8862394a14d req-b2a58209-6af1-4c6b-b590-c68106d1a726 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] No waiting events found dispatching network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:48:26 user nova-compute[74421]: WARNING nova.compute.manager [req-ef28081b-2bd6-401a-8030-c8862394a14d req-b2a58209-6af1-4c6b-b590-c68106d1a726 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received unexpected event network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 for instance with vm_state active and task_state None.
Oct 23 15:48:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid d65e6022-8249-4185-b4c1-96ad8a86a6f2 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:48:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:53 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:53 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:48:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:48:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:48:53 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:48:54 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:48:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:48:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:48:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:48:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:48:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:48:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:48:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:48:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:48:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:01 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:49:01 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=24.991790771484375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fd38a03f-899c-440f-b9a4-3311884941c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d65e6022-8249-4185-b4c1-96ad8a86a6f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:49:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:49:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:49:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:49:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:49:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:49:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-changed-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG nova.compute.manager [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing instance network info cache due to event network-changed-37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updated VIF entry in instance network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:49:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4435456d-8476-4882-a615-5b78f65c433b req-6c6e8ff4-dafb-4ecc-a0cb-14a01da46494 service nova] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:49:05 user nova-compute[74421]: INFO nova.compute.manager [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Detaching volume 5fa6a9a6-068c-43f9-8349-4936d0b82135
Oct 23 15:49:05 user nova-compute[74421]: INFO nova.virt.block_device [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Attempting to driver detach volume 5fa6a9a6-068c-43f9-8349-4936d0b82135 from mountpoint /dev/vdb
Oct 23 15:49:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Attempting to detach device vdb from instance fd38a03f-899c-440f-b9a4-3311884941c3 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:49:05 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:49:05 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:49:05 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:49:05 user nova-compute[74421]:   <serial>5fa6a9a6-068c-43f9-8349-4936d0b82135</serial>
Oct 23 15:49:05 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 15:49:05 user nova-compute[74421]: </disk>
Oct 23 15:49:05 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:49:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully detached device vdb from instance fd38a03f-899c-440f-b9a4-3311884941c3 from the persistent domain config.
Oct 23 15:49:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd38a03f-899c-440f-b9a4-3311884941c3 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:49:05 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:49:05 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:49:05 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:49:05 user nova-compute[74421]:   <serial>5fa6a9a6-068c-43f9-8349-4936d0b82135</serial>
Oct 23 15:49:05 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 15:49:05 user nova-compute[74421]: </disk>
Oct 23 15:49:05 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-changed-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing instance network info cache due to event network-changed-37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Refreshing network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updated VIF entry in instance network info cache for port 37875513-43bb-490a-bddf-7b8523dc998e. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:49:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0554f673-6510-4b16-9b91-eeff8ac9dde4 req-98649578-a333-4ee9-bd5c-8dba76317b8a service nova] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:49:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:49:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:49:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:49:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:49:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:49:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-changed-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:49:13 user nova-compute[74421]: DEBUG nova.compute.manager [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Refreshing instance network info cache due to event network-changed-e6c1d886-be17-4cea-937b-cf12ed229cb9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:49:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] Acquiring lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:49:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] Acquired lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:49:13 user nova-compute[74421]: DEBUG nova.network.neutron [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Refreshing network info cache for port e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:49:14 user nova-compute[74421]: DEBUG nova.network.neutron [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updated VIF entry in instance network info cache for port e6c1d886-be17-4cea-937b-cf12ed229cb9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:49:14 user nova-compute[74421]: DEBUG nova.network.neutron [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:49:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-13f7d8c8-a911-4512-ab2d-f01160679a61 req-c057a692-e5d3-43bd-a23a-d1ba5bcace18 service nova] Releasing lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:49:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:49:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:49:18 user nova-compute[74421]: DEBUG nova.objects.instance [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid d65e6022-8249-4185-b4c1-96ad8a86a6f2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:49:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:49:19 user nova-compute[74421]: INFO nova.compute.manager [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Attaching volume fd1a5714-0c5e-4d4e-b308-8e3943dc5aa1 to /dev/vdb
Oct 23 15:49:19 user nova-compute[74421]: DEBUG os_brick.utils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[645bb72a-8b43-4410-b840-d750426d8468]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e34db-6fa3-4090-8f3e-8141665248ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b64340-ff89-4bf7-855d-9c817b6e2f50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[da708e92-3d57-425d-83a6-fc8e475175e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:49:19 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:49:19 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b270744-37f8-4f33-9256-fdf700757d88]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG os_brick.utils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:49:19 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating existing volume attachment record: ebbfe5c1-c550-4714-8af6-cec82df0ad27 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:49:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:25 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd38a03f-899c-440f-b9a4-3311884941c3 is timed out.
Oct 23 15:49:25 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully detached device vdb from instance fd38a03f-899c-440f-b9a4-3311884941c3 from the live domain config.
Oct 23 15:49:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:49:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfhZIDTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:49:25 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:49:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:49:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:49:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fdd650-c826-4c0d-a7c2-197ce34985d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:49:26 user nova-compute[74421]: No targets found.
Oct 23 15:49:26 user nova-compute[74421]: iSNS:
Oct 23 15:49:26 user nova-compute[74421]: No targets found.
Oct 23 15:49:26 user nova-compute[74421]: STATIC:
Oct 23 15:49:26 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135
Oct 23 15:49:26 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:49:26 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:49:26 user nova-compute[74421]: FIRMWARE:
Oct 23 15:49:26 user nova-compute[74421]: No targets found.
Oct 23 15:49:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:49:26 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:49:26 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f867c2ae-9f52-4bfd-8faf-52746b86fa4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a0891d-a590-4dc6-925e-3e9576d7f83f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:49:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 (non-flash)
Oct 23 15:49:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24781ad090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[94407763-a6ef-4f91-8d52-e3f244f4a9d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea070227-e18e-425e-9496-3fe1c8b6c5aa]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a910b877-4770-4feb-9164-49309b533d20]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e4207-2af7-4eb1-8233-c7533e28852d]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac7d535-7b0d-41e8-8a1c-a9b52050d67b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad458a5-eb88-4d34-8762-96a5130d9d0c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260]
Oct 23 15:49:26 user nova-compute[74421]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135, portal: 172.16.0.220,3260] successful.
Oct 23 15:49:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fa6a9a6-068c-43f9-8349-4936d0b82135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b35112-1e21-4472-95cc-eaa691055ae3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== disconnect_volume: return (288ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:49:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:49:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:49:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:49:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:49:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:49:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:29 user nova-compute[74421]: DEBUG nova.objects.instance [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'flavor' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:49:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-68bbe5bf-a8c1-4e26-bbd6-57d1b804eb2f tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.342s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.volume.cinder [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Update attachment failed for attachment ebbfe5c1-c550-4714-8af6-cec82df0ad27. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1293991-83ec-4ed9-b424-43040122604d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1293991-83ec-4ed9-b424-43040122604d)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Failed to attach fd1a5714-0c5e-4d4e-b308-8e3943dc5aa1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1293991-83ec-4ed9-b424-43040122604d)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Traceback (most recent call last):
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     ret_val = method(obj, context, *args, **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     self._do_attach(context, instance, volume, volume_api,
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     self._volume_attach(context, volume, connector, instance,
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     connection_info = volume_api.attachment_update(
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     res = method(self, ctx, *args, **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     with excutils.save_and_reraise_exception():
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     self.force_reraise()
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     raise self.value
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     return method.func(obj, *args, **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     resp = self._update('/attachments/%s' % id, body)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     return self.request(url, method, **kwargs)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2]     raise exceptions.from_response(resp, body)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1293991-83ec-4ed9-b424-43040122604d)
Oct 23 15:49:29 user nova-compute[74421]: ERROR nova.compute.manager [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] 
Oct 23 15:49:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.884s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server [None req-77eb65a0-eede-4b86-9bb0-ca91cebe2bce tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1293991-83ec-4ed9-b424-43040122604d)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1293991-83ec-4ed9-b424-43040122604d)
Oct 23 15:49:30 user nova-compute[74421]: ERROR oslo_messaging.rpc.server 
Oct 23 15:49:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:49:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:56 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [{"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:49:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-fd38a03f-899c-440f-b9a4-3311884941c3" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:49:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:49:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:49:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:49:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:49:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:49:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:49:59 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:01 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:50:01 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:50:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=24.988327026367188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fd38a03f-899c-440f-b9a4-3311884941c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d65e6022-8249-4185-b4c1-96ad8a86a6f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:08 user nova-compute[74421]: INFO nova.compute.manager [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Terminating instance
Oct 23 15:50:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-9c41bffa-5da4-4c1f-9492-e1cb34b271bd req-090101fa-1b0b-4192-9513-c57e88479645 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-unplugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9c41bffa-5da4-4c1f-9492-e1cb34b271bd req-090101fa-1b0b-4192-9513-c57e88479645 service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9c41bffa-5da4-4c1f-9492-e1cb34b271bd req-090101fa-1b0b-4192-9513-c57e88479645 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9c41bffa-5da4-4c1f-9492-e1cb34b271bd req-090101fa-1b0b-4192-9513-c57e88479645 service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-9c41bffa-5da4-4c1f-9492-e1cb34b271bd req-090101fa-1b0b-4192-9513-c57e88479645 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-unplugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-9c41bffa-5da4-4c1f-9492-e1cb34b271bd req-090101fa-1b0b-4192-9513-c57e88479645 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-unplugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Instance destroyed successfully.
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'resources' on Instance uuid fd38a03f-899c-440f-b9a4-3311884941c3 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-690149044',display_name='tempest-TestMinimumBasicScenario-server-690149044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-690149044',id=40,image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVrF6qY32TP+U8xhcaM85ZRVobVNM9KWn0MAOa0iFqRENM4CzxRwRVyVl4Q33cN97Dbd0TCutwWn09XIFcGfTwv8Xv8LwjulpM5xzb24oLw07DAlcM99yCzGfLG0QAC9Q==',key_name='tempest-TestMinimumBasicScenario-966738554',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-0zcaq5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='578f8aba-8ffe-4510-ad09-e6a6a2942eba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:47:20Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=fd38a03f-899c-440f-b9a4-3311884941c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "37875513-43bb-490a-bddf-7b8523dc998e", "address": "fa:16:3e:43:ed:0d", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37875513-43", "ovs_interfaceid": "37875513-43bb-490a-bddf-7b8523dc998e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG os_vif [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37875513-43, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d435929-320e-409a-8c45-b78395a1ac22) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:09 user nova-compute[74421]: INFO os_vif [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:0d,bridge_name='br-int',has_traffic_filtering=True,id=37875513-43bb-490a-bddf-7b8523dc998e,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37875513-43')
Oct 23 15:50:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Deleting instance files /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3_del
Oct 23 15:50:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Deletion of /opt/stack/data/nova/instances/fd38a03f-899c-440f-b9a4-3311884941c3_del complete
Oct 23 15:50:09 user nova-compute[74421]: INFO nova.compute.manager [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 15:50:09 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:50:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-867acf8d-6fac-4149-bee4-23b9556eba32 req-e9acea2c-f469-4061-80eb-3404b9f614d9 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-deleted-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:50:10 user nova-compute[74421]: INFO nova.compute.manager [req-867acf8d-6fac-4149-bee4-23b9556eba32 req-e9acea2c-f469-4061-80eb-3404b9f614d9 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Neutron deleted interface 37875513-43bb-490a-bddf-7b8523dc998e; detaching it from the instance and deleting it from the info cache
Oct 23 15:50:10 user nova-compute[74421]: DEBUG nova.network.neutron [req-867acf8d-6fac-4149-bee4-23b9556eba32 req-e9acea2c-f469-4061-80eb-3404b9f614d9 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-867acf8d-6fac-4149-bee4-23b9556eba32 req-e9acea2c-f469-4061-80eb-3404b9f614d9 service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Detach interface failed, port_id=37875513-43bb-490a-bddf-7b8523dc998e, reason: Instance fd38a03f-899c-440f-b9a4-3311884941c3 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:50:10 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Took 0.66 seconds to deallocate network for instance.
Oct 23 15:50:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:10 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Deleted allocations for instance fd38a03f-899c-440f-b9a4-3311884941c3
Oct 23 15:50:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c52f6a1a-3abd-4b82-af82-7a8a5c7d2876 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "fd38a03f-899c-440f-b9a4-3311884941c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-9bc45e6d-7d62-4bdd-b1ec-91c2bbea7a60 req-e457ecac-4626-44db-94a6-414ab700191c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:50:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9bc45e6d-7d62-4bdd-b1ec-91c2bbea7a60 req-e457ecac-4626-44db-94a6-414ab700191c service nova] Acquiring lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9bc45e6d-7d62-4bdd-b1ec-91c2bbea7a60 req-e457ecac-4626-44db-94a6-414ab700191c service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9bc45e6d-7d62-4bdd-b1ec-91c2bbea7a60 req-e457ecac-4626-44db-94a6-414ab700191c service nova] Lock "fd38a03f-899c-440f-b9a4-3311884941c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-9bc45e6d-7d62-4bdd-b1ec-91c2bbea7a60 req-e457ecac-4626-44db-94a6-414ab700191c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] No waiting events found dispatching network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:50:11 user nova-compute[74421]: WARNING nova.compute.manager [req-9bc45e6d-7d62-4bdd-b1ec-91c2bbea7a60 req-e457ecac-4626-44db-94a6-414ab700191c service nova] [instance: fd38a03f-899c-440f-b9a4-3311884941c3] Received unexpected event network-vif-plugged-37875513-43bb-490a-bddf-7b8523dc998e for instance with vm_state deleted and task_state None.
Oct 23 15:50:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-changed-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG nova.compute.manager [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Refreshing instance network info cache due to event network-changed-97268cc8-85ca-47ce-9384-305fc8089c35. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] Acquiring lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] Acquired lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG nova.network.neutron [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Refreshing network info cache for port 97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG nova.network.neutron [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updated VIF entry in instance network info cache for port 97268cc8-85ca-47ce-9384-305fc8089c35. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG nova.network.neutron [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'flavor' on Instance uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-471c0a3b-11fd-409c-88ba-e575e19bef9a req-79e79c9d-8ba9-43ec-ba1c-b7dddec3fdb3 service nova] Releasing lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:12 user nova-compute[74421]: INFO nova.compute.manager [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Attaching volume fc10d907-e199-49e3-b272-9b068c7b6e1a to /dev/vdb
Oct 23 15:50:13 user nova-compute[74421]: DEBUG os_brick.utils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e17159-05db-432d-b264-0c9fefa46215]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e11435c-6542-4a5c-86a8-e7a850a616ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2faab9d-cd0b-451a-8235-b69fdc32e122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633cb58-7586-489e-a5fb-f462bc42d467]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:50:13 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:50:13 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b941e1-5621-42e0-8eeb-8aec5e4845bf]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG os_brick.utils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:50:13 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating existing volume attachment record: 3c406daa-7e82-400c-809e-4e34ff105f5e {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:50:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1899e076-d0f7-46af-90d1-4a354946890c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:50:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:18 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:50:18 user nova-compute[74421]: INFO nova.compute.claims [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Claim successful on node user
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:50:19 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:50:19 user nova-compute[74421]: INFO nova.virt.block_device [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Booting with volume snapshot c2b97c08-4f58-4fea-82e9-8130b99e1af1 at /dev/vda
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.policy [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8decd53c14b49fe8ab2765e7f0c726d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beee00c4721f4f89942da65f6571c1d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:19 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Successfully created port: aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Successfully updated port: aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "refresh_cache-1899e076-d0f7-46af-90d1-4a354946890c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquired lock "refresh_cache-1899e076-d0f7-46af-90d1-4a354946890c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-changed-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Refreshing instance network info cache due to event network-changed-aed2ebba-2f16-46a9-aa12-8cd70908aa2c. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] Acquiring lock "refresh_cache-1899e076-d0f7-46af-90d1-4a354946890c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Updating instance_info_cache with network_info: [{"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Releasing lock "refresh_cache-1899e076-d0f7-46af-90d1-4a354946890c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Instance network_info: |[{"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] Acquired lock "refresh_cache-1899e076-d0f7-46af-90d1-4a354946890c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Refreshing network info cache for port aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:50:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:21 user nova-compute[74421]: DEBUG nova.network.neutron [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Updated VIF entry in instance network info cache for port aed2ebba-2f16-46a9-aa12-8cd70908aa2c. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:50:21 user nova-compute[74421]: DEBUG nova.network.neutron [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Updating instance_info_cache with network_info: [{"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:50:21 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-30f7b371-c44e-4459-a2d8-976050003f76 req-e9f58aa8-0f4f-46c0-8df2-5df43b2e5337 service nova] Releasing lock "refresh_cache-1899e076-d0f7-46af-90d1-4a354946890c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:50:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxEFihPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:50:36 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:50:36 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:50:36 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[10077ac2-0c5f-4c38-a625-c4b238a8e05c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:50:36 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e3cda-b489-45ce-82f4-f07f857fcebd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a] added
Oct 23 15:50:36 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f47d2-9957-42c8-9bb0-7e3877755706]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f0e90-d68d-4c9e-8a19-5a91a0f278b6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxEFihPg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxEFihPg" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e673698-0a42-4258-97e9-ef75acb9a0d6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxEFihPg'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b9773-9900-40be-8aa5-7e1f9c8ad3cf]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7671673-5ca5-4c37-8dec-9aa5c1d0ef5c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:50:36 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:50:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:50:36 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:50:36 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 15:50:36 user nova-compute[74421]: 
Oct 23 15:50:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66323af-91e7-4826-8fbd-eb0084ced420]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260]
Oct 23 15:50:37 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260] successful.
Oct 23 15:50:37 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ab0e55-852f-48dc-9ae0-30e59de463cc]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7824c42-d60d-476c-93ae-f5b07b4e4847]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:50:37 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:50:37 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d878022-52d7-4bfc-9d94-dbeefbdf4e1e]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:50:37 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxEFihPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26461313633636565', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461313633636565', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG nova.objects.instance [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'flavor' on Instance uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:50:38 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:50:38 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:50:38 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:50:38 user nova-compute[74421]:   <serial>fc10d907-e199-49e3-b272-9b068c7b6e1a</serial>
Oct 23 15:50:38 user nova-compute[74421]: </disk>
Oct 23 15:50:38 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No VIF found with MAC fa:16:3e:22:53:55, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:50:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-b390d762-e0f1-4e62-b2c4-2dfaeeadfa62 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.702s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG os_brick.utils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[276748a7-33d0-47de-8281-e8d59bc37b7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db694c-5c2f-4682-a6e2-5f78101865b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3589a573-ed4c-425d-9073-119dbe004c18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c54c6bf-8a1f-4e18-ab2e-bc7bdbdedc6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:50:40 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:50:40 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db5c15-e539-47fe-a9f0-5158f10b8526]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG os_brick.utils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Updating existing volume attachment record: b53b2867-81bf-4a51-b588-bd3db1fdd244 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:50:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:41 user nova-compute[74421]: INFO nova.compute.manager [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Detaching volume fc10d907-e199-49e3-b272-9b068c7b6e1a
Oct 23 15:50:41 user nova-compute[74421]: INFO nova.virt.block_device [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Attempting to driver detach volume fc10d907-e199-49e3-b272-9b068c7b6e1a from mountpoint /dev/vdb
Oct 23 15:50:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Attempting to detach device vdb from instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:50:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:50:41 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:50:41 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:50:41 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:50:41 user nova-compute[74421]:   <serial>fc10d907-e199-49e3-b272-9b068c7b6e1a</serial>
Oct 23 15:50:41 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:50:41 user nova-compute[74421]: </disk>
Oct 23 15:50:41 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:50:41 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully detached device vdb from instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f from the persistent domain config.
Oct 23 15:50:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:50:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:50:41 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:50:41 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:50:41 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:50:41 user nova-compute[74421]:   <serial>fc10d907-e199-49e3-b272-9b068c7b6e1a</serial>
Oct 23 15:50:41 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:50:41 user nova-compute[74421]: </disk>
Oct 23 15:50:41 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:50:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:50:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:50:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Creating image(s)
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Ensure instance console log exists: /opt/stack/data/nova/instances/1899e076-d0f7-46af-90d1-4a354946890c/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Start _get_guest_xml network_info=[{"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'b53b2867-81bf-4a51-b588-bd3db1fdd244', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCMrzKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1899e076-d0f7-46af-90d1-4a354946890c', 'attached_at': '', 'detached_at': '', 'volume_id': '070011e6-a754-4dd7-bcf1-067488eb8303', 'serial': '070011e6-a754-4dd7-bcf1-067488eb8303'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:50:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:50:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCMrzKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:50:56 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:50:56 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:50:56 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57415cbd-c970-4d2a-a3c6-c4a6e7a0fb39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:50:56 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1820195-c506-4b14-80b1-25bf8e32d041]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303] added
Oct 23 15:50:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00ca00b-e945-44c8-bf3d-95bfdb62ff71]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d95b365-4ef3-4450-9523-bfc4784d422c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGCMrzKZ {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGCMrzKZ" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[177fd2ce-d530-47a1-8fd5-d68dec69fb13]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGCMrzKZ'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7645c3-b337-4193-a0c0-74f217795d79]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca69792-9c5b-421f-b8d3-d14abc6ea25d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:50:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:50:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f635e421-eea9-4b7d-ad26-36b7df568301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260]
Oct 23 15:50:56 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260] successful.
Oct 23 15:50:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[734c7699-b568-474c-a572-a41445c03148]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b198978-b927-4a4c-9c4b-9a9c47f0033c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:50:56 user nova-compute[74421]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)
Oct 23 15:50:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:50:56 user nova-compute[74421]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)
Oct 23 15:50:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8734974b-6420-44eb-b020-5b03b63aa9bc]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:50:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCMrzKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26164623563636364', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:50:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164623563636364', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:50:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620025460',display_name='tempest-TestVolumeBootPattern-server-1620025460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620025460',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-apz3d9s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:50:19Z,user_data=None,user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=1899e076-d0f7-46af-90d1-4a354946890c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lazy-loading 'pci_devices' on Instance uuid 1899e076-d0f7-46af-90d1-4a354946890c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:50:58 user nova-compute[74421]:   <uuid>1899e076-d0f7-46af-90d1-4a354946890c</uuid>
Oct 23 15:50:58 user nova-compute[74421]:   <name>instance-0000002b</name>
Oct 23 15:50:58 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:50:58 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:50:58 user nova-compute[74421]:   <metadata>
Oct 23 15:50:58 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:50:58 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:50:58 user nova-compute[74421]:       <nova:name>tempest-TestVolumeBootPattern-server-1620025460</nova:name>
Oct 23 15:50:58 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:50:56</nova:creationTime>
Oct 23 15:50:58 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:50:58 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:50:58 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:50:58 user nova-compute[74421]:       <nova:owner>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:user uuid="d8decd53c14b49fe8ab2765e7f0c726d">tempest-TestVolumeBootPattern-1940666020-project-member</nova:user>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:project uuid="beee00c4721f4f89942da65f6571c1d8">tempest-TestVolumeBootPattern-1940666020</nova:project>
Oct 23 15:50:58 user nova-compute[74421]:       </nova:owner>
Oct 23 15:50:58 user nova-compute[74421]:       <nova:ports>
Oct 23 15:50:58 user nova-compute[74421]:         <nova:port uuid="aed2ebba-2f16-46a9-aa12-8cd70908aa2c">
Oct 23 15:50:58 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 15:50:58 user nova-compute[74421]:         </nova:port>
Oct 23 15:50:58 user nova-compute[74421]:       </nova:ports>
Oct 23 15:50:58 user nova-compute[74421]:     </nova:instance>
Oct 23 15:50:58 user nova-compute[74421]:   </metadata>
Oct 23 15:50:58 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:50:58 user nova-compute[74421]:     <system>
Oct 23 15:50:58 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:50:58 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:50:58 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:50:58 user nova-compute[74421]:       <entry name="serial">1899e076-d0f7-46af-90d1-4a354946890c</entry>
Oct 23 15:50:58 user nova-compute[74421]:       <entry name="uuid">1899e076-d0f7-46af-90d1-4a354946890c</entry>
Oct 23 15:50:58 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:50:58 user nova-compute[74421]:     </system>
Oct 23 15:50:58 user nova-compute[74421]:   </sysinfo>
Oct 23 15:50:58 user nova-compute[74421]:   <os>
Oct 23 15:50:58 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:50:58 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:50:58 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:50:58 user nova-compute[74421]:   </os>
Oct 23 15:50:58 user nova-compute[74421]:   <features>
Oct 23 15:50:58 user nova-compute[74421]:     <acpi/>
Oct 23 15:50:58 user nova-compute[74421]:     <apic/>
Oct 23 15:50:58 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:50:58 user nova-compute[74421]:   </features>
Oct 23 15:50:58 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:50:58 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:50:58 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:50:58 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:50:58 user nova-compute[74421]:   </clock>
Oct 23 15:50:58 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:50:58 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:50:58 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:50:58 user nova-compute[74421]:   </cpu>
Oct 23 15:50:58 user nova-compute[74421]:   <devices>
Oct 23 15:50:58 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:50:58 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:50:58 user nova-compute[74421]:       <source dev="/dev/sdc"/>
Oct 23 15:50:58 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:50:58 user nova-compute[74421]:       <serial>070011e6-a754-4dd7-bcf1-067488eb8303</serial>
Oct 23 15:50:58 user nova-compute[74421]:     </disk>
Oct 23 15:50:58 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:50:58 user nova-compute[74421]:       <mac address="fa:16:3e:b4:21:57"/>
Oct 23 15:50:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:50:58 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:50:58 user nova-compute[74421]:       <target dev="tapaed2ebba-2f"/>
Oct 23 15:50:58 user nova-compute[74421]:     </interface>
Oct 23 15:50:58 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:50:58 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/1899e076-d0f7-46af-90d1-4a354946890c/console.log" append="off"/>
Oct 23 15:50:58 user nova-compute[74421]:     </serial>
Oct 23 15:50:58 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:50:58 user nova-compute[74421]:     <video>
Oct 23 15:50:58 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:50:58 user nova-compute[74421]:     </video>
Oct 23 15:50:58 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:50:58 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:50:58 user nova-compute[74421]:     </rng>
Oct 23 15:50:58 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:50:58 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:50:58 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:50:58 user nova-compute[74421]:     </memballoon>
Oct 23 15:50:58 user nova-compute[74421]:   </devices>
Oct 23 15:50:58 user nova-compute[74421]: </domain>
Oct 23 15:50:58 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:50:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620025460',display_name='tempest-TestVolumeBootPattern-server-1620025460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620025460',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-apz3d9s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:50:19Z,user_data=None,user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=1899e076-d0f7-46af-90d1-4a354946890c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG os_vif [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf209f7e-6904-5082-b747-1f3de6986d44', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaed2ebba-2f, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaed2ebba-2f, col_values=(('qos', UUID('13805381-551a-4748-8768-75e802de7647')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaed2ebba-2f, col_values=(('external_ids', {'iface-id': 'aed2ebba-2f16-46a9-aa12-8cd70908aa2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:21:57', 'vm-uuid': '1899e076-d0f7-46af-90d1-4a354946890c'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:58 user nova-compute[74421]: INFO os_vif [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f')
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] No VIF found with MAC fa:16:3e:b4:21:57, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [{"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-d65e6022-8249-4185-b4c1-96ad8a86a6f2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:50:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd73f696-32ff-49df-af50-c7fd7499d42a req-1fb3b9bd-bbe0-4dbb-8ace-e2332b018a3a service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd73f696-32ff-49df-af50-c7fd7499d42a req-1fb3b9bd-bbe0-4dbb-8ace-e2332b018a3a service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd73f696-32ff-49df-af50-c7fd7499d42a req-1fb3b9bd-bbe0-4dbb-8ace-e2332b018a3a service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd73f696-32ff-49df-af50-c7fd7499d42a req-1fb3b9bd-bbe0-4dbb-8ace-e2332b018a3a service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:50:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd73f696-32ff-49df-af50-c7fd7499d42a req-1fb3b9bd-bbe0-4dbb-8ace-e2332b018a3a service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:50:59 user nova-compute[74421]: WARNING nova.compute.manager [req-bd73f696-32ff-49df-af50-c7fd7499d42a req-1fb3b9bd-bbe0-4dbb-8ace-e2332b018a3a service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received unexpected event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with vm_state building and task_state spawning.
Oct 23 15:50:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:51:01 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Instance spawned successfully.
Oct 23 15:51:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:02 user nova-compute[74421]: INFO nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:51:02 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f is timed out.
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-88271ed5-4c6f-446d-ac36-62cb383f0e6e req-821cbb49-1bbf-4243-a6c5-333f19270f5a service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-88271ed5-4c6f-446d-ac36-62cb383f0e6e req-821cbb49-1bbf-4243-a6c5-333f19270f5a service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-88271ed5-4c6f-446d-ac36-62cb383f0e6e req-821cbb49-1bbf-4243-a6c5-333f19270f5a service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-88271ed5-4c6f-446d-ac36-62cb383f0e6e req-821cbb49-1bbf-4243-a6c5-333f19270f5a service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.manager [req-88271ed5-4c6f-446d-ac36-62cb383f0e6e req-821cbb49-1bbf-4243-a6c5-333f19270f5a service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:51:02 user nova-compute[74421]: WARNING nova.compute.manager [req-88271ed5-4c6f-446d-ac36-62cb383f0e6e req-821cbb49-1bbf-4243-a6c5-333f19270f5a service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received unexpected event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with vm_state building and task_state spawning.
Oct 23 15:51:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully detached device vdb from instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f from the live domain config.
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxEFihPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:51:02 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:51:02 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=25.044921875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1bae21-e853-49ce-a3b9-54bbda6192ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:51:02 user nova-compute[74421]: No targets found.
Oct 23 15:51:02 user nova-compute[74421]: iSNS:
Oct 23 15:51:02 user nova-compute[74421]: No targets found.
Oct 23 15:51:02 user nova-compute[74421]: STATIC:
Oct 23 15:51:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303
Oct 23 15:51:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:51:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:51:02 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a
Oct 23 15:51:02 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:51:02 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:51:02 user nova-compute[74421]: FIRMWARE:
Oct 23 15:51:02 user nova-compute[74421]: No targets found.
Oct 23 15:51:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:51:02 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:51:02 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f4e10-6ad7-45c9-8e26-9e08babeb79c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a7499-b297-4e50-8155-e555ad81ec31]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:51:02 user nova-compute[74421]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)
Oct 23 15:51:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a (non-flash)
Oct 23 15:51:02 user nova-compute[74421]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)
Oct 23 15:51:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247857ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: INFO nova.compute.manager [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Took 43.45 seconds to build instance.
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae22edc-80cd-4898-8120-0c92c3f9553e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dedfb10-b610-4b4a-b944-6139c4b0910c]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c65db4af-546b-4884-84cd-e50c3113be99 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1899e076-d0f7-46af-90d1-4a354946890c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.639s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f706b3-1048-4869-abc0-4ebcb421cd82]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d65e6022-8249-4185-b4c1-96ad8a86a6f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 1899e076-d0f7-46af-90d1-4a354946890c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f1af3-ae26-4325-98b4-eda9ceaf5a26]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1beb6d1-c1b4-4b64-87a2-a31895f46331]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[09147af7-e1ba-440a-8a6e-1f91dc359dd3]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260]
Oct 23 15:51:02 user nova-compute[74421]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a, portal: 172.16.0.220,3260] successful.
Oct 23 15:51:02 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc10d907-e199-49e3-b272-9b068c7b6e1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f42ae80-49e7-496e-acb5-fb6e31848c28]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] <== disconnect_volume: return (377ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:51:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.objects.instance [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'flavor' on Instance uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-79b78caf-f394-493a-87fa-a749219536ef tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:51:03 user nova-compute[74421]: INFO nova.compute.claims [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Claim successful on node user
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:51:03 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:51:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG nova.policy [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae006290eb4d49609eee46250660adb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3c0fda43d4b42a16478be0d47270b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:51:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Creating image(s)
Oct 23 15:51:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "/opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "/opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "/opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "0d8e4278b2ae402fb7a81a2464ccbd14fcd75716" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "0d8e4278b2ae402fb7a81a2464ccbd14fcd75716" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Successfully created port: eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG nova.virt.images [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] 15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.part /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.part /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.converted" returned: 0 in 0.311s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "0d8e4278b2ae402fb7a81a2464ccbd14fcd75716" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.650s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "0d8e4278b2ae402fb7a81a2464ccbd14fcd75716" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "0d8e4278b2ae402fb7a81a2464ccbd14fcd75716" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Successfully updated port: eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing instance network info cache due to event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 --force-share --output=json" returned: 0 in 0.230s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716,backing_fmt=raw /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716,backing_fmt=raw /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk 1073741824" returned: 0 in 0.083s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "0d8e4278b2ae402fb7a81a2464ccbd14fcd75716" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 --force-share --output=json" returned: 0 in 0.198s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance network_info: |[{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.neutron [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Cannot resize image /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Ensure instance console log exists: /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Start _get_guest_xml network_info=[{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:51:00Z,direct_url=<?>,disk_format='qcow2',id=15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d,min_disk=0,min_ram=0,name='tempest-scenario-img--708761056',owner='88f3c0fda43d4b42a16478be0d47270b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:51:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:51:06 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:51:06 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:51:00Z,direct_url=<?>,disk_format='qcow2',id=15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d,min_disk=0,min_ram=0,name='tempest-scenario-img--708761056',owner='88f3c0fda43d4b42a16478be0d47270b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:51:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-159858116',display_name='tempest-TestMinimumBasicScenario-server-159858116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-159858116',id=44,image_ref='15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsrZTtz4R7MCRsI11bcpCPChR0Xd1CPEpd14vWmj3XcsVnTzZOik+RfWxiN+lJRE2xGjxekPGg11G063U+yUfd/+Bmd7iGjj9Z0CvKbtPmtrJe2Dz+oAWdPYHe9v3IOCw==',key_name='tempest-TestMinimumBasicScenario-1504781756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-5ptg9zh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:51:04Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=d31bcfcf-56bd-45b3-b01a-13371fb36cb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.objects.instance [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'pci_devices' on Instance uuid d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:51:06 user nova-compute[74421]:   <uuid>d31bcfcf-56bd-45b3-b01a-13371fb36cb2</uuid>
Oct 23 15:51:06 user nova-compute[74421]:   <name>instance-0000002c</name>
Oct 23 15:51:06 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:51:06 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:51:06 user nova-compute[74421]:   <metadata>
Oct 23 15:51:06 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:51:06 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:51:06 user nova-compute[74421]:       <nova:name>tempest-TestMinimumBasicScenario-server-159858116</nova:name>
Oct 23 15:51:06 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:51:06</nova:creationTime>
Oct 23 15:51:06 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:51:06 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:51:06 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:51:06 user nova-compute[74421]:       <nova:owner>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:user uuid="ae006290eb4d49609eee46250660adb8">tempest-TestMinimumBasicScenario-1824567034-project-member</nova:user>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:project uuid="88f3c0fda43d4b42a16478be0d47270b">tempest-TestMinimumBasicScenario-1824567034</nova:project>
Oct 23 15:51:06 user nova-compute[74421]:       </nova:owner>
Oct 23 15:51:06 user nova-compute[74421]:       <nova:root type="image" uuid="15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d"/>
Oct 23 15:51:06 user nova-compute[74421]:       <nova:ports>
Oct 23 15:51:06 user nova-compute[74421]:         <nova:port uuid="eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296">
Oct 23 15:51:06 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:51:06 user nova-compute[74421]:         </nova:port>
Oct 23 15:51:06 user nova-compute[74421]:       </nova:ports>
Oct 23 15:51:06 user nova-compute[74421]:     </nova:instance>
Oct 23 15:51:06 user nova-compute[74421]:   </metadata>
Oct 23 15:51:06 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:51:06 user nova-compute[74421]:     <system>
Oct 23 15:51:06 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:51:06 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:51:06 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:51:06 user nova-compute[74421]:       <entry name="serial">d31bcfcf-56bd-45b3-b01a-13371fb36cb2</entry>
Oct 23 15:51:06 user nova-compute[74421]:       <entry name="uuid">d31bcfcf-56bd-45b3-b01a-13371fb36cb2</entry>
Oct 23 15:51:06 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:51:06 user nova-compute[74421]:     </system>
Oct 23 15:51:06 user nova-compute[74421]:   </sysinfo>
Oct 23 15:51:06 user nova-compute[74421]:   <os>
Oct 23 15:51:06 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:51:06 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:51:06 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:51:06 user nova-compute[74421]:   </os>
Oct 23 15:51:06 user nova-compute[74421]:   <features>
Oct 23 15:51:06 user nova-compute[74421]:     <acpi/>
Oct 23 15:51:06 user nova-compute[74421]:     <apic/>
Oct 23 15:51:06 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:51:06 user nova-compute[74421]:   </features>
Oct 23 15:51:06 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:51:06 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:51:06 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:51:06 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:51:06 user nova-compute[74421]:   </clock>
Oct 23 15:51:06 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:51:06 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:51:06 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:51:06 user nova-compute[74421]:   </cpu>
Oct 23 15:51:06 user nova-compute[74421]:   <devices>
Oct 23 15:51:06 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:51:06 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:51:06 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk"/>
Oct 23 15:51:06 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:51:06 user nova-compute[74421]:     </disk>
Oct 23 15:51:06 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:51:06 user nova-compute[74421]:       <mac address="fa:16:3e:02:4d:03"/>
Oct 23 15:51:06 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:51:06 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:51:06 user nova-compute[74421]:       <target dev="tapeb1c3a8d-94"/>
Oct 23 15:51:06 user nova-compute[74421]:     </interface>
Oct 23 15:51:06 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:51:06 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/console.log" append="off"/>
Oct 23 15:51:06 user nova-compute[74421]:     </serial>
Oct 23 15:51:06 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:51:06 user nova-compute[74421]:     <video>
Oct 23 15:51:06 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:51:06 user nova-compute[74421]:     </video>
Oct 23 15:51:06 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:51:06 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:51:06 user nova-compute[74421]:     </rng>
Oct 23 15:51:06 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:51:06 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:51:06 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:51:06 user nova-compute[74421]:     </memballoon>
Oct 23 15:51:06 user nova-compute[74421]:   </devices>
Oct 23 15:51:06 user nova-compute[74421]: </domain>
Oct 23 15:51:06 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-159858116',display_name='tempest-TestMinimumBasicScenario-server-159858116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-159858116',id=44,image_ref='15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsrZTtz4R7MCRsI11bcpCPChR0Xd1CPEpd14vWmj3XcsVnTzZOik+RfWxiN+lJRE2xGjxekPGg11G063U+yUfd/+Bmd7iGjj9Z0CvKbtPmtrJe2Dz+oAWdPYHe9v3IOCw==',key_name='tempest-TestMinimumBasicScenario-1504781756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-5ptg9zh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:51:04Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=d31bcfcf-56bd-45b3-b01a-13371fb36cb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG os_vif [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a85ef118-1979-5e99-98af-fbe55f00e00b', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb1c3a8d-94, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb1c3a8d-94, col_values=(('qos', UUID('81267630-9dd5-473c-a82d-f58d70fa6a2d')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb1c3a8d-94, col_values=(('external_ids', {'iface-id': 'eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:4d:03', 'vm-uuid': 'd31bcfcf-56bd-45b3-b01a-13371fb36cb2'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:06 user nova-compute[74421]: INFO os_vif [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94')
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:51:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No VIF found with MAC fa:16:3e:02:4d:03, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:51:07 user nova-compute[74421]: DEBUG nova.network.neutron [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated VIF entry in instance network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:51:07 user nova-compute[74421]: DEBUG nova.network.neutron [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:51:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-99b98111-882a-4a22-8258-f3552534ba61 req-3ba8a2ca-933f-403a-9a72-e739aa86054d service nova] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:51:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-86a6066c-93d9-4f6f-9c3d-42345830790c req-2f5da5c3-3153-4abe-a3b4-42d7852928d2 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86a6066c-93d9-4f6f-9c3d-42345830790c req-2f5da5c3-3153-4abe-a3b4-42d7852928d2 service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86a6066c-93d9-4f6f-9c3d-42345830790c req-2f5da5c3-3153-4abe-a3b4-42d7852928d2 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-86a6066c-93d9-4f6f-9c3d-42345830790c req-2f5da5c3-3153-4abe-a3b4-42d7852928d2 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG nova.compute.manager [req-86a6066c-93d9-4f6f-9c3d-42345830790c req-2f5da5c3-3153-4abe-a3b4-42d7852928d2 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:51:08 user nova-compute[74421]: WARNING nova.compute.manager [req-86a6066c-93d9-4f6f-9c3d-42345830790c req-2f5da5c3-3153-4abe-a3b4-42d7852928d2 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state building and task_state spawning.
Oct 23 15:51:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-14b7f242-c2c0-4d13-967f-7740a8bfb1ac req-3203652d-908b-4f50-b9ed-138fd24e0128 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-14b7f242-c2c0-4d13-967f-7740a8bfb1ac req-3203652d-908b-4f50-b9ed-138fd24e0128 service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-14b7f242-c2c0-4d13-967f-7740a8bfb1ac req-3203652d-908b-4f50-b9ed-138fd24e0128 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-14b7f242-c2c0-4d13-967f-7740a8bfb1ac req-3203652d-908b-4f50-b9ed-138fd24e0128 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.compute.manager [req-14b7f242-c2c0-4d13-967f-7740a8bfb1ac req-3203652d-908b-4f50-b9ed-138fd24e0128 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:51:10 user nova-compute[74421]: WARNING nova.compute.manager [req-14b7f242-c2c0-4d13-967f-7740a8bfb1ac req-3203652d-908b-4f50-b9ed-138fd24e0128 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state building and task_state spawning.
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:51:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance spawned successfully.
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:10 user nova-compute[74421]: INFO nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Took 6.47 seconds to spawn the instance on the hypervisor.
Oct 23 15:51:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:51:10 user nova-compute[74421]: INFO nova.compute.manager [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Took 7.20 seconds to build instance.
Oct 23 15:51:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-749b-478e-86b0-9c89230bd191 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.297s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:11 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:51:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:51:42 user nova-compute[74421]: INFO nova.compute.manager [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] instance snapshotting
Oct 23 15:51:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Beginning live snapshot process
Oct 23 15:51:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json -f qcow2 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz3jan9pv/e199cc8ebec44bbea5d713c8f0f86a47.delta 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz3jan9pv/e199cc8ebec44bbea5d713c8f0f86a47.delta 1073741824" returned: 0 in 0.051s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:43 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 15:51:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:51:44 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74421) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 15:51:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 15:51:44 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:51:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz3jan9pv/e199cc8ebec44bbea5d713c8f0f86a47.delta /opt/stack/data/nova/instances/snapshots/tmpz3jan9pv/e199cc8ebec44bbea5d713c8f0f86a47 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz3jan9pv/e199cc8ebec44bbea5d713c8f0f86a47.delta /opt/stack/data/nova/instances/snapshots/tmpz3jan9pv/e199cc8ebec44bbea5d713c8f0f86a47" returned: 0 in 0.326s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:44 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Snapshot extracted, beginning image upload
Oct 23 15:51:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:47 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Snapshot image upload complete
Oct 23 15:51:47 user nova-compute[74421]: INFO nova.compute.manager [None req-b6574231-73fd-4097-ba89-92c819a857b5 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Took 4.99 seconds to snapshot the instance on the hypervisor.
Oct 23 15:51:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:48 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:48 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:51:49 user nova-compute[74421]: INFO nova.compute.claims [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Claim successful on node user
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.network.neutron [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:51:49 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:51:49 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Creating image(s)
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "/opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "/opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "280e3e3ee4f2f24dfc35f24016066c8d69711064" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:49 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "280e3e3ee4f2f24dfc35f24016066c8d69711064" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.part --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:50 user nova-compute[74421]: DEBUG nova.policy [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbea674c96a747fd9517812e6800a19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6441b3c331748b5b2203328b2595f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG nova.virt.images [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] cf9984b4-c94e-41b1-a86e-9856e75e5a8a was qcow2, converting to raw {{(pid=74421) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG nova.privsep.utils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74421) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.part /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.converted {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.part /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.converted" returned: 0 in 0.525s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.converted --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "280e3e3ee4f2f24dfc35f24016066c8d69711064" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.173s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG nova.network.neutron [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Successfully created port: 56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "280e3e3ee4f2f24dfc35f24016066c8d69711064" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "280e3e3ee4f2f24dfc35f24016066c8d69711064" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064,backing_fmt=raw /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064,backing_fmt=raw /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk 1073741824" returned: 0 in 0.053s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "280e3e3ee4f2f24dfc35f24016066c8d69711064" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Ensure instance console log exists: /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Successfully updated port: 56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquired lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-changed-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Refreshing instance network info cache due to event network-changed-56f0611e-2643-413c-a8e4-f8df841e0766. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] Acquiring lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.neutron [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updating instance_info_cache with network_info: [{"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Releasing lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Instance network_info: |[{"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] Acquired lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.neutron [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Refreshing network info cache for port 56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Start _get_guest_xml network_info=[{"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='84bcd439467377e97fff62e88aa110bb',container_format='bare',created_at=2023-10-23T15:51:42Z,direct_url=<?>,disk_format='qcow2',id=cf9984b4-c94e-41b1-a86e-9856e75e5a8a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1350721735',owner='f6441b3c331748b5b2203328b2595f37',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T15:51:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'cf9984b4-c94e-41b1-a86e-9856e75e5a8a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:51:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:51:52 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='84bcd439467377e97fff62e88aa110bb',container_format='bare',created_at=2023-10-23T15:51:42Z,direct_url=<?>,disk_format='qcow2',id=cf9984b4-c94e-41b1-a86e-9856e75e5a8a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1350721735',owner='f6441b3c331748b5b2203328b2595f37',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T15:51:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1883773447',display_name='tempest-TestStampPattern-server-1883773447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1883773447',id=45,image_ref='cf9984b4-c94e-41b1-a86e-9856e75e5a8a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDVqurofzLMZNAaghRQtpJ19oylFKFhcxcqMDmzqCiNpsP1f695EadLkKhqxpHR8kS2jYtqlGFt0+J9RecbAT98pcr/b42YIaDLq3lZwwq4BIP60C4+g0H7X1GAdN6Bw==',key_name='tempest-TestStampPattern-1526100776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6441b3c331748b5b2203328b2595f37',ramdisk_id='',reservation_id='r-fw08m2o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f',image_min_disk='1',image_min_ram='0',image_owner_id='f6441b3c331748b5b2203328b2595f37',image_owner_project_name='tempest-TestStampPattern-320376849',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-320376849-project-member',image_user_id='dbea674c96a747fd9517812e6800a19f',network_allocated='True',owner_project_name='tempest-TestStampPattern-320376849',owner_user_name='tempest-TestStampPattern-320376849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:51:50Z,user_data=None,user_id='dbea674c96a747fd9517812e6800a19f',uuid=fe9824d1-80f5-48dc-816a-ba3507ec935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converting VIF {"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:51:52 user nova-compute[74421]: DEBUG nova.objects.instance [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'pci_devices' on Instance uuid fe9824d1-80f5-48dc-816a-ba3507ec935c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:51:53 user nova-compute[74421]:   <uuid>fe9824d1-80f5-48dc-816a-ba3507ec935c</uuid>
Oct 23 15:51:53 user nova-compute[74421]:   <name>instance-0000002d</name>
Oct 23 15:51:53 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:51:53 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:51:53 user nova-compute[74421]:   <metadata>
Oct 23 15:51:53 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:51:53 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:51:53 user nova-compute[74421]:       <nova:name>tempest-TestStampPattern-server-1883773447</nova:name>
Oct 23 15:51:53 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:51:52</nova:creationTime>
Oct 23 15:51:53 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:51:53 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:51:53 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:51:53 user nova-compute[74421]:       <nova:owner>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:user uuid="dbea674c96a747fd9517812e6800a19f">tempest-TestStampPattern-320376849-project-member</nova:user>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:project uuid="f6441b3c331748b5b2203328b2595f37">tempest-TestStampPattern-320376849</nova:project>
Oct 23 15:51:53 user nova-compute[74421]:       </nova:owner>
Oct 23 15:51:53 user nova-compute[74421]:       <nova:root type="image" uuid="cf9984b4-c94e-41b1-a86e-9856e75e5a8a"/>
Oct 23 15:51:53 user nova-compute[74421]:       <nova:ports>
Oct 23 15:51:53 user nova-compute[74421]:         <nova:port uuid="56f0611e-2643-413c-a8e4-f8df841e0766">
Oct 23 15:51:53 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 15:51:53 user nova-compute[74421]:         </nova:port>
Oct 23 15:51:53 user nova-compute[74421]:       </nova:ports>
Oct 23 15:51:53 user nova-compute[74421]:     </nova:instance>
Oct 23 15:51:53 user nova-compute[74421]:   </metadata>
Oct 23 15:51:53 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:51:53 user nova-compute[74421]:     <system>
Oct 23 15:51:53 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:51:53 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:51:53 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:51:53 user nova-compute[74421]:       <entry name="serial">fe9824d1-80f5-48dc-816a-ba3507ec935c</entry>
Oct 23 15:51:53 user nova-compute[74421]:       <entry name="uuid">fe9824d1-80f5-48dc-816a-ba3507ec935c</entry>
Oct 23 15:51:53 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:51:53 user nova-compute[74421]:     </system>
Oct 23 15:51:53 user nova-compute[74421]:   </sysinfo>
Oct 23 15:51:53 user nova-compute[74421]:   <os>
Oct 23 15:51:53 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:51:53 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:51:53 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:51:53 user nova-compute[74421]:   </os>
Oct 23 15:51:53 user nova-compute[74421]:   <features>
Oct 23 15:51:53 user nova-compute[74421]:     <acpi/>
Oct 23 15:51:53 user nova-compute[74421]:     <apic/>
Oct 23 15:51:53 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:51:53 user nova-compute[74421]:   </features>
Oct 23 15:51:53 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:51:53 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:51:53 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:51:53 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:51:53 user nova-compute[74421]:   </clock>
Oct 23 15:51:53 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:51:53 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:51:53 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:51:53 user nova-compute[74421]:   </cpu>
Oct 23 15:51:53 user nova-compute[74421]:   <devices>
Oct 23 15:51:53 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:51:53 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:51:53 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk"/>
Oct 23 15:51:53 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:51:53 user nova-compute[74421]:     </disk>
Oct 23 15:51:53 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:51:53 user nova-compute[74421]:       <mac address="fa:16:3e:d5:73:7f"/>
Oct 23 15:51:53 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:51:53 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:51:53 user nova-compute[74421]:       <target dev="tap56f0611e-26"/>
Oct 23 15:51:53 user nova-compute[74421]:     </interface>
Oct 23 15:51:53 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:51:53 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/console.log" append="off"/>
Oct 23 15:51:53 user nova-compute[74421]:     </serial>
Oct 23 15:51:53 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:51:53 user nova-compute[74421]:     <video>
Oct 23 15:51:53 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:51:53 user nova-compute[74421]:     </video>
Oct 23 15:51:53 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:51:53 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:51:53 user nova-compute[74421]:     </rng>
Oct 23 15:51:53 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:51:53 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:51:53 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:51:53 user nova-compute[74421]:     </memballoon>
Oct 23 15:51:53 user nova-compute[74421]:   </devices>
Oct 23 15:51:53 user nova-compute[74421]: </domain>
Oct 23 15:51:53 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1883773447',display_name='tempest-TestStampPattern-server-1883773447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1883773447',id=45,image_ref='cf9984b4-c94e-41b1-a86e-9856e75e5a8a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDVqurofzLMZNAaghRQtpJ19oylFKFhcxcqMDmzqCiNpsP1f695EadLkKhqxpHR8kS2jYtqlGFt0+J9RecbAT98pcr/b42YIaDLq3lZwwq4BIP60C4+g0H7X1GAdN6Bw==',key_name='tempest-TestStampPattern-1526100776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6441b3c331748b5b2203328b2595f37',ramdisk_id='',reservation_id='r-fw08m2o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f',image_min_disk='1',image_min_ram='0',image_owner_id='f6441b3c331748b5b2203328b2595f37',image_owner_project_name='tempest-TestStampPattern-320376849',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-320376849-project-member',image_user_id='dbea674c96a747fd9517812e6800a19f',network_allocated='True',owner_project_name='tempest-TestStampPattern-320376849',owner_user_name='tempest-TestStampPattern-320376849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:51:50Z,user_data=None,user_id='dbea674c96a747fd9517812e6800a19f',uuid=fe9824d1-80f5-48dc-816a-ba3507ec935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converting VIF {"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG os_vif [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45c7672f-7528-51ec-b53b-4626c5bcf5b4', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56f0611e-26, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56f0611e-26, col_values=(('qos', UUID('cd11750e-a41b-467f-bf4e-4ec499e8e91a')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56f0611e-26, col_values=(('external_ids', {'iface-id': '56f0611e-2643-413c-a8e4-f8df841e0766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:73:7f', 'vm-uuid': 'fe9824d1-80f5-48dc-816a-ba3507ec935c'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:53 user nova-compute[74421]: INFO os_vif [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26')
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No VIF found with MAC fa:16:3e:d5:73:7f, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updated VIF entry in instance network info cache for port 56f0611e-2643-413c-a8e4-f8df841e0766. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updating instance_info_cache with network_info: [{"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:51:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-85a1bcaa-9cd3-48d4-8a59-73df7db03178 req-1c853e1e-b747-400b-ae09-e806da9430a8 service nova] Releasing lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-ace1312f-ff4d-443a-bf65-fdc5f23d2c3e req-5a7d0f75-5595-4669-a699-2e1cb634ba80 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ace1312f-ff4d-443a-bf65-fdc5f23d2c3e req-5a7d0f75-5595-4669-a699-2e1cb634ba80 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ace1312f-ff4d-443a-bf65-fdc5f23d2c3e req-5a7d0f75-5595-4669-a699-2e1cb634ba80 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-ace1312f-ff4d-443a-bf65-fdc5f23d2c3e req-5a7d0f75-5595-4669-a699-2e1cb634ba80 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-ace1312f-ff4d-443a-bf65-fdc5f23d2c3e req-5a7d0f75-5595-4669-a699-2e1cb634ba80 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:51:54 user nova-compute[74421]: WARNING nova.compute.manager [req-ace1312f-ff4d-443a-bf65-fdc5f23d2c3e req-5a7d0f75-5595-4669-a699-2e1cb634ba80 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state building and task_state spawning.
Oct 23 15:51:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:51:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Instance spawned successfully.
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:51:56 user nova-compute[74421]: INFO nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Took 7.12 seconds to spawn the instance on the hypervisor.
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-25680df7-c28d-4509-963b-616974700412 req-a44b614b-c40a-465f-8fb6-950ccfa409fc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25680df7-c28d-4509-963b-616974700412 req-a44b614b-c40a-465f-8fb6-950ccfa409fc service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25680df7-c28d-4509-963b-616974700412 req-a44b614b-c40a-465f-8fb6-950ccfa409fc service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-25680df7-c28d-4509-963b-616974700412 req-a44b614b-c40a-465f-8fb6-950ccfa409fc service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:56 user nova-compute[74421]: DEBUG nova.compute.manager [req-25680df7-c28d-4509-963b-616974700412 req-a44b614b-c40a-465f-8fb6-950ccfa409fc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:51:56 user nova-compute[74421]: WARNING nova.compute.manager [req-25680df7-c28d-4509-963b-616974700412 req-a44b614b-c40a-465f-8fb6-950ccfa409fc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state building and task_state spawning.
Oct 23 15:51:56 user nova-compute[74421]: INFO nova.compute.manager [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Took 7.81 seconds to build instance.
Oct 23 15:51:56 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-eada9adb-303e-4267-a721-f934b3e87927 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.904s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:51:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:51:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:59 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:51:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:51:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:51:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:51:59 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:52:00 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:52:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:52:00 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:52:01 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:03 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:52:03 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=24.801090240478516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d65e6022-8249-4185-b4c1-96ad8a86a6f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 1899e076-d0f7-46af-90d1-4a354946890c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fe9824d1-80f5-48dc-816a-ba3507ec935c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:52:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:52:04 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:52:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:52:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:52:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1899e076-d0f7-46af-90d1-4a354946890c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:09 user nova-compute[74421]: INFO nova.compute.manager [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Terminating instance
Oct 23 15:52:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-0c4bdfdc-26ef-4c2f-82c9-25a7fe9505a4 req-15f97c82-b065-46f2-8df7-ca12fa22f293 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-unplugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0c4bdfdc-26ef-4c2f-82c9-25a7fe9505a4 req-15f97c82-b065-46f2-8df7-ca12fa22f293 service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0c4bdfdc-26ef-4c2f-82c9-25a7fe9505a4 req-15f97c82-b065-46f2-8df7-ca12fa22f293 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0c4bdfdc-26ef-4c2f-82c9-25a7fe9505a4 req-15f97c82-b065-46f2-8df7-ca12fa22f293 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-0c4bdfdc-26ef-4c2f-82c9-25a7fe9505a4 req-15f97c82-b065-46f2-8df7-ca12fa22f293 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-unplugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-0c4bdfdc-26ef-4c2f-82c9-25a7fe9505a4 req-15f97c82-b065-46f2-8df7-ca12fa22f293 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-unplugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Instance destroyed successfully.
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.objects.instance [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lazy-loading 'resources' on Instance uuid 1899e076-d0f7-46af-90d1-4a354946890c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:50:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620025460',display_name='tempest-TestVolumeBootPattern-server-1620025460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620025460',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-apz3d9s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:51:02Z,user_data=None,user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=1899e076-d0f7-46af-90d1-4a354946890c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "address": "fa:16:3e:b4:21:57", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed2ebba-2f", "ovs_interfaceid": "aed2ebba-2f16-46a9-aa12-8cd70908aa2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_vif [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaed2ebba-2f, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13805381-551a-4748-8768-75e802de7647) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:52:10 user nova-compute[74421]: INFO os_vif [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:57,bridge_name='br-int',has_traffic_filtering=True,id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed2ebba-2f')
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCMrzKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:52:10 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90753d-5889-4899-88bf-802bb2673af4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:52:10 user nova-compute[74421]: No targets found.
Oct 23 15:52:10 user nova-compute[74421]: iSNS:
Oct 23 15:52:10 user nova-compute[74421]: No targets found.
Oct 23 15:52:10 user nova-compute[74421]: STATIC:
Oct 23 15:52:10 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303
Oct 23 15:52:10 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:52:10 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:52:10 user nova-compute[74421]: FIRMWARE:
Oct 23 15:52:10 user nova-compute[74421]: No targets found.
Oct 23 15:52:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:52:10 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:52:10 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ae20d-a24a-43cb-8b07-220f414b5991]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efdd120-d097-4400-924a-6d56c73c1034]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)
Oct 23 15:52:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 (non-flash)
Oct 23 15:52:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478135fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c4031-669e-4c78-9f61-3f22fce64559]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b3a1f-d58d-4cf0-acb3-f8203120a298]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[830e9753-1627-4fee-baa8-6bd0ce093ff2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7bf1a-5bdc-4826-a9e9-367a2f00195c]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[00574c81-5dda-48d3-943b-50b015e16991]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[462bea40-9b4b-4a44-99a4-af726cc4675f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260]
Oct 23 15:52:10 user nova-compute[74421]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303, portal: 172.16.0.220,3260] successful.
Oct 23 15:52:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070011e6-a754-4dd7-bcf1-067488eb8303 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324965e-aebf-4d09-a42b-9eac9386061b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== disconnect_volume: return (300ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:52:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Deleting instance files /opt/stack/data/nova/instances/1899e076-d0f7-46af-90d1-4a354946890c_del
Oct 23 15:52:10 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Deletion of /opt/stack/data/nova/instances/1899e076-d0f7-46af-90d1-4a354946890c_del complete
Oct 23 15:52:10 user nova-compute[74421]: INFO nova.compute.manager [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 23 15:52:10 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:52:11 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Took 0.54 seconds to deallocate network for instance.
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-c45fdb58-48ce-4bc9-835c-04037ddb908a req-f443044d-de48-4805-8748-e8fc506eaa1d service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-deleted-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:11 user nova-compute[74421]: INFO nova.compute.manager [req-c45fdb58-48ce-4bc9-835c-04037ddb908a req-f443044d-de48-4805-8748-e8fc506eaa1d service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Neutron deleted interface aed2ebba-2f16-46a9-aa12-8cd70908aa2c; detaching it from the instance and deleting it from the info cache
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.network.neutron [req-c45fdb58-48ce-4bc9-835c-04037ddb908a req-f443044d-de48-4805-8748-e8fc506eaa1d service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-c45fdb58-48ce-4bc9-835c-04037ddb908a req-f443044d-de48-4805-8748-e8fc506eaa1d service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Detach interface failed, port_id=aed2ebba-2f16-46a9-aa12-8cd70908aa2c, reason: Instance 1899e076-d0f7-46af-90d1-4a354946890c could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:11 user nova-compute[74421]: WARNING nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received unexpected event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with vm_state active and task_state deleting.
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:11 user nova-compute[74421]: WARNING nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received unexpected event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with vm_state active and task_state deleting.
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:11 user nova-compute[74421]: WARNING nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received unexpected event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with vm_state active and task_state deleting.
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-unplugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-unplugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-unplugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Acquiring lock "1899e076-d0f7-46af-90d1-4a354946890c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] Lock "1899e076-d0f7-46af-90d1-4a354946890c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] No waiting events found dispatching network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:11 user nova-compute[74421]: WARNING nova.compute.manager [req-08848738-53e1-4267-b699-e167bd5966e3 req-72f12d4f-a6e0-4c93-a824-ad1815e85d08 service nova] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Received unexpected event network-vif-plugged-aed2ebba-2f16-46a9-aa12-8cd70908aa2c for instance with vm_state active and task_state deleting.
Oct 23 15:52:11 user nova-compute[74421]: INFO nova.compute.manager [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Took 0.78 seconds to detach 1 volumes for instance.
Oct 23 15:52:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1899e076-d0f7-46af-90d1-4a354946890c] Deleting volume: 070011e6-a754-4dd7-bcf1-067488eb8303 {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 15:52:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:12 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:52:12 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:52:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:12 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Deleted allocations for instance 1899e076-d0f7-46af-90d1-4a354946890c
Oct 23 15:52:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-50908402-b4fb-4699-ae1e-ee7dce289903 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1899e076-d0f7-46af-90d1-4a354946890c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:34 user nova-compute[74421]: INFO nova.compute.manager [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Terminating instance
Oct 23 15:52:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-6c784bd1-db01-4645-9edd-3fb7eb3a2212 req-90fe946c-188e-4930-a0ab-0e4d207b3ddd service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-vif-unplugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6c784bd1-db01-4645-9edd-3fb7eb3a2212 req-90fe946c-188e-4930-a0ab-0e4d207b3ddd service nova] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6c784bd1-db01-4645-9edd-3fb7eb3a2212 req-90fe946c-188e-4930-a0ab-0e4d207b3ddd service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-6c784bd1-db01-4645-9edd-3fb7eb3a2212 req-90fe946c-188e-4930-a0ab-0e4d207b3ddd service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-6c784bd1-db01-4645-9edd-3fb7eb3a2212 req-90fe946c-188e-4930-a0ab-0e4d207b3ddd service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] No waiting events found dispatching network-vif-unplugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-6c784bd1-db01-4645-9edd-3fb7eb3a2212 req-90fe946c-188e-4930-a0ab-0e4d207b3ddd service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-vif-unplugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Instance destroyed successfully.
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.objects.instance [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'resources' on Instance uuid d65e6022-8249-4185-b4c1-96ad8a86a6f2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1480907857',display_name='tempest-AttachVolumeTestJSON-server-1480907857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1480907857',id=41,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhNGEMbJuySVkH62ikVdQ1HgAqXYwZVQqJGHaQKXN3tbNJtq2g7hcG3TnFMhecgkdrPaKhvpgPhL2+ybH+RyIPRMkVgF/nQKizAUBudxpENLQAuD+hQjkVqLXfmrW7KUg==',key_name='tempest-keypair-2137116288',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:47:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c934c4c4f0304483809e410717e63030',ramdisk_id='',reservation_id='r-1eqpc4fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-532911348',owner_user_name='tempest-AttachVolumeTestJSON-532911348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9af9227b4e74b97a2ee0b2aca32e74e',uuid=d65e6022-8249-4185-b4c1-96ad8a86a6f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converting VIF {"id": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "address": "fa:16:3e:7d:5a:90", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1d886-be", "ovs_interfaceid": "e6c1d886-be17-4cea-937b-cf12ed229cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG os_vif [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c1d886-be, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=248fa654-e40d-453b-aff3-081954d30fe6) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:52:35 user nova-compute[74421]: INFO os_vif [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5a:90,bridge_name='br-int',has_traffic_filtering=True,id=e6c1d886-be17-4cea-937b-cf12ed229cb9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1d886-be')
Oct 23 15:52:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Deleting instance files /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2_del
Oct 23 15:52:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Deletion of /opt/stack/data/nova/instances/d65e6022-8249-4185-b4c1-96ad8a86a6f2_del complete
Oct 23 15:52:35 user nova-compute[74421]: INFO nova.compute.manager [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 23 15:52:35 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:52:35 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:52:36 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Took 0.85 seconds to deallocate network for instance.
Oct 23 15:52:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-5ed16813-18ba-4510-98b8-8122632a0e57 req-fe67313d-c786-430c-8d3f-4e891a71723e service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-vif-deleted-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:36 user nova-compute[74421]: INFO nova.compute.manager [req-5ed16813-18ba-4510-98b8-8122632a0e57 req-fe67313d-c786-430c-8d3f-4e891a71723e service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Neutron deleted interface e6c1d886-be17-4cea-937b-cf12ed229cb9; detaching it from the instance and deleting it from the info cache
Oct 23 15:52:36 user nova-compute[74421]: DEBUG nova.network.neutron [req-5ed16813-18ba-4510-98b8-8122632a0e57 req-fe67313d-c786-430c-8d3f-4e891a71723e service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG nova.compute.manager [req-5ed16813-18ba-4510-98b8-8122632a0e57 req-fe67313d-c786-430c-8d3f-4e891a71723e service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Detach interface failed, port_id=e6c1d886-be17-4cea-937b-cf12ed229cb9, reason: Instance d65e6022-8249-4185-b4c1-96ad8a86a6f2 could not be found. {{(pid=74421) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:52:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:36 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Deleted allocations for instance d65e6022-8249-4185-b4c1-96ad8a86a6f2
Oct 23 15:52:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-feb8e145-d629-42c6-9a92-852ddacc62d0 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f3c0343-2775-4400-bc75-313c3d978d5c req-c093e114-550e-4c01-820a-7f65a083b8c5 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received event network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:52:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f3c0343-2775-4400-bc75-313c3d978d5c req-c093e114-550e-4c01-820a-7f65a083b8c5 service nova] Acquiring lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f3c0343-2775-4400-bc75-313c3d978d5c req-c093e114-550e-4c01-820a-7f65a083b8c5 service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8f3c0343-2775-4400-bc75-313c3d978d5c req-c093e114-550e-4c01-820a-7f65a083b8c5 service nova] Lock "d65e6022-8249-4185-b4c1-96ad8a86a6f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f3c0343-2775-4400-bc75-313c3d978d5c req-c093e114-550e-4c01-820a-7f65a083b8c5 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] No waiting events found dispatching network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:52:37 user nova-compute[74421]: WARNING nova.compute.manager [req-8f3c0343-2775-4400-bc75-313c3d978d5c req-c093e114-550e-4c01-820a-7f65a083b8c5 service nova] [instance: d65e6022-8249-4185-b4c1-96ad8a86a6f2] Received unexpected event network-vif-plugged-e6c1d886-be17-4cea-937b-cf12ed229cb9 for instance with vm_state deleted and task_state None.
Oct 23 15:52:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:52:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:52:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:52:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:52:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:52:57 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:52:58 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG nova.objects.instance [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'flavor' on Instance uuid d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:52:59 user nova-compute[74421]: INFO nova.compute.manager [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Attaching volume e6d96309-77dd-4457-9e8d-9d0e8c492605 to /dev/vdb
Oct 23 15:52:59 user nova-compute[74421]: DEBUG os_brick.utils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:52:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f7d56-5f30-42d4-bb68-cebfd2b20aec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35a859-2f1a-42c2-aa18-e2dc52e2def6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea376d-851a-4ee0-9413-c780386c6edc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a02ea-41de-4a45-ab06-abec68c8f0f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:53:00 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:53:00 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1710e3b8-a2c8-48f8-aa4f-08c9da24a1de]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG os_brick.utils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating existing volume attachment record: 56416ab9-f414-45fa-b071-8d4b3f7dbe12 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:53:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:53:01 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:53:02 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:04 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:53:04 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=24.826431274414062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fe9824d1-80f5-48dc-816a-ba3507ec935c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:53:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:11 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:53:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:53:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:53:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:53:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuIACrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:53:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:53:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:53:24 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4bbb49-ebab-4881-8fa7-6432b89ab2b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:53:24 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e2602-d34a-490c-a382-c2d2760cc50a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605] added
Oct 23 15:53:24 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04b3fd-873d-4cca-b07c-35df2ae3d195]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfdf4c-29d3-481a-b95a-7637eec88584]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JuIACrSU {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JuIACrSU" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acf6b76-2ef3-4777-9e32-f5b5e9cfd28b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JuIACrSU'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d5c244-5ff1-492f-8927-a861b01d9dd2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f814f-0ab0-455a-9370-e9e4d58b7638]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:53:24 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:53:24 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 15:53:24 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:53:24 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 15:53:24 user nova-compute[74421]: 
Oct 23 15:53:24 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a65e29-ca58-45f7-9466-0e3989624102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260]
Oct 23 15:53:25 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260] successful.
Oct 23 15:53:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e571fba-a953-42e8-824f-fdc73dcd9128]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9a51e5-b5dc-44c2-bc43-79dbb31f6324]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:25 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e2e8c-e177-4638-9d7b-84326b8025b0]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuIACrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23334643936306131', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334643936306131', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG nova.objects.instance [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'flavor' on Instance uuid d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:53:26 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:53:26 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:53:26 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:53:26 user nova-compute[74421]:   <serial>e6d96309-77dd-4457-9e8d-9d0e8c492605</serial>
Oct 23 15:53:26 user nova-compute[74421]: </disk>
Oct 23 15:53:26 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] No VIF found with MAC fa:16:3e:02:4d:03, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:53:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-00f91655-4d8f-41a9-8dcf-7b909c711d3a tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.832s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:53:29 user nova-compute[74421]: INFO nova.compute.claims [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Claim successful on node user
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:53:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.policy [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9af9227b4e74b97a2ee0b2aca32e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c934c4c4f0304483809e410717e63030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:53:29 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Creating image(s)
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "/opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "/opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.174s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing instance network info cache due to event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG nova.network.neutron [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk 1073741824" returned: 0 in 0.063s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:29 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Successfully created port: 165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Cannot resize image /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Ensure instance console log exists: /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated VIF entry in instance network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-203174e1-ebab-4745-ae6d-fa00798f6a27 req-74830c68-5293-4e65-b805-9430c750b276 service nova] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Successfully updated port: 165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquired lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-changed-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Refreshing instance network info cache due to event network-changed-165b1d15-62cb-42df-a1ec-6f822b4fd6d9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] Acquiring lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.neutron [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updating instance_info_cache with network_info: [{"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Releasing lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Instance network_info: |[{"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] Acquired lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Refreshing network info cache for port 165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Start _get_guest_xml network_info=[{"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:53:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:53:31 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2022515064',display_name='tempest-AttachVolumeTestJSON-server-2022515064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2022515064',id=46,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLepw68i0DaOm8RHyRP5go+/x9TxWInGau3GfA2xAjO1pcfoIRfDKfmPPyhm+PwEr8kuGgpYGd/Lv72m10Wta2kLyy/PErEOejMV+rAVwMLl88zrugCLIdaAjC9jZI9B2A==',key_name='tempest-keypair-686852889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c934c4c4f0304483809e410717e63030',ramdisk_id='',reservation_id='r-plgzxsqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-532911348',owner_user_name='tempest-AttachVolumeTestJSON-532911348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9af9227b4e74b97a2ee0b2aca32e74e',uuid=bf08160e-b7c2-41d8-ae07-b645570dcfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converting VIF {"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.objects.instance [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'pci_devices' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:53:31 user nova-compute[74421]:   <uuid>bf08160e-b7c2-41d8-ae07-b645570dcfb8</uuid>
Oct 23 15:53:31 user nova-compute[74421]:   <name>instance-0000002e</name>
Oct 23 15:53:31 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:53:31 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:53:31 user nova-compute[74421]:   <metadata>
Oct 23 15:53:31 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:53:31 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:53:31 user nova-compute[74421]:       <nova:name>tempest-AttachVolumeTestJSON-server-2022515064</nova:name>
Oct 23 15:53:31 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:53:31</nova:creationTime>
Oct 23 15:53:31 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:53:31 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:53:31 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:53:31 user nova-compute[74421]:       <nova:owner>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:user uuid="d9af9227b4e74b97a2ee0b2aca32e74e">tempest-AttachVolumeTestJSON-532911348-project-member</nova:user>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:project uuid="c934c4c4f0304483809e410717e63030">tempest-AttachVolumeTestJSON-532911348</nova:project>
Oct 23 15:53:31 user nova-compute[74421]:       </nova:owner>
Oct 23 15:53:31 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 15:53:31 user nova-compute[74421]:       <nova:ports>
Oct 23 15:53:31 user nova-compute[74421]:         <nova:port uuid="165b1d15-62cb-42df-a1ec-6f822b4fd6d9">
Oct 23 15:53:31 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 15:53:31 user nova-compute[74421]:         </nova:port>
Oct 23 15:53:31 user nova-compute[74421]:       </nova:ports>
Oct 23 15:53:31 user nova-compute[74421]:     </nova:instance>
Oct 23 15:53:31 user nova-compute[74421]:   </metadata>
Oct 23 15:53:31 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:53:31 user nova-compute[74421]:     <system>
Oct 23 15:53:31 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:53:31 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:53:31 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:53:31 user nova-compute[74421]:       <entry name="serial">bf08160e-b7c2-41d8-ae07-b645570dcfb8</entry>
Oct 23 15:53:31 user nova-compute[74421]:       <entry name="uuid">bf08160e-b7c2-41d8-ae07-b645570dcfb8</entry>
Oct 23 15:53:31 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:53:31 user nova-compute[74421]:     </system>
Oct 23 15:53:31 user nova-compute[74421]:   </sysinfo>
Oct 23 15:53:31 user nova-compute[74421]:   <os>
Oct 23 15:53:31 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:53:31 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:53:31 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:53:31 user nova-compute[74421]:   </os>
Oct 23 15:53:31 user nova-compute[74421]:   <features>
Oct 23 15:53:31 user nova-compute[74421]:     <acpi/>
Oct 23 15:53:31 user nova-compute[74421]:     <apic/>
Oct 23 15:53:31 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:53:31 user nova-compute[74421]:   </features>
Oct 23 15:53:31 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:53:31 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:53:31 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:53:31 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:53:31 user nova-compute[74421]:   </clock>
Oct 23 15:53:31 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:53:31 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:53:31 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:53:31 user nova-compute[74421]:   </cpu>
Oct 23 15:53:31 user nova-compute[74421]:   <devices>
Oct 23 15:53:31 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 15:53:31 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 15:53:31 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk"/>
Oct 23 15:53:31 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:53:31 user nova-compute[74421]:     </disk>
Oct 23 15:53:31 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:53:31 user nova-compute[74421]:       <mac address="fa:16:3e:0e:e1:77"/>
Oct 23 15:53:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:53:31 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:53:31 user nova-compute[74421]:       <target dev="tap165b1d15-62"/>
Oct 23 15:53:31 user nova-compute[74421]:     </interface>
Oct 23 15:53:31 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:53:31 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/console.log" append="off"/>
Oct 23 15:53:31 user nova-compute[74421]:     </serial>
Oct 23 15:53:31 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:53:31 user nova-compute[74421]:     <video>
Oct 23 15:53:31 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:53:31 user nova-compute[74421]:     </video>
Oct 23 15:53:31 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:53:31 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:53:31 user nova-compute[74421]:     </rng>
Oct 23 15:53:31 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:53:31 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:53:31 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:53:31 user nova-compute[74421]:     </memballoon>
Oct 23 15:53:31 user nova-compute[74421]:   </devices>
Oct 23 15:53:31 user nova-compute[74421]: </domain>
Oct 23 15:53:31 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2022515064',display_name='tempest-AttachVolumeTestJSON-server-2022515064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2022515064',id=46,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLepw68i0DaOm8RHyRP5go+/x9TxWInGau3GfA2xAjO1pcfoIRfDKfmPPyhm+PwEr8kuGgpYGd/Lv72m10Wta2kLyy/PErEOejMV+rAVwMLl88zrugCLIdaAjC9jZI9B2A==',key_name='tempest-keypair-686852889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c934c4c4f0304483809e410717e63030',ramdisk_id='',reservation_id='r-plgzxsqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-532911348',owner_user_name='tempest-AttachVolumeTestJSON-532911348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9af9227b4e74b97a2ee0b2aca32e74e',uuid=bf08160e-b7c2-41d8-ae07-b645570dcfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converting VIF {"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG os_vif [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d1579df-2f84-5b61-b3d8-843a512ce416', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap165b1d15-62, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap165b1d15-62, col_values=(('qos', UUID('3b58929e-dd82-41ae-b6a2-840486eefa5a')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap165b1d15-62, col_values=(('external_ids', {'iface-id': '165b1d15-62cb-42df-a1ec-6f822b4fd6d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:e1:77', 'vm-uuid': 'bf08160e-b7c2-41d8-ae07-b645570dcfb8'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:31 user nova-compute[74421]: INFO os_vif [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62')
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No VIF found with MAC fa:16:3e:0e:e1:77, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updated VIF entry in instance network info cache for port 165b1d15-62cb-42df-a1ec-6f822b4fd6d9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updating instance_info_cache with network_info: [{"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3b2d9bc5-40f4-4069-8c3b-afa8903250b1 req-4e2ff620-b83f-4931-84f6-1cd47f660e43 service nova] Releasing lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG nova.compute.manager [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing instance network info cache due to event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated VIF entry in instance network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG nova.network.neutron [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4304e507-8bd7-4b64-a84d-3da905bd5c78 req-13802c6d-8e45-42be-b6d7-5a749bc513ca service nova] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:32 user nova-compute[74421]: INFO nova.compute.manager [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Rebooting instance
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:32 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:53:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:33 user nova-compute[74421]: DEBUG nova.network.neutron [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] No waiting events found dispatching network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:34 user nova-compute[74421]: WARNING nova.compute.manager [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received unexpected event network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 for instance with vm_state building and task_state spawning.
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] No waiting events found dispatching network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:34 user nova-compute[74421]: WARNING nova.compute.manager [req-f3ed1a24-098d-432a-adc9-bff1f8c52aa9 req-c4a7e75a-6abd-4f40-b48e-b2092e91aca7 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received unexpected event network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 for instance with vm_state building and task_state spawning.
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:53:34 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Instance spawned successfully.
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:34 user nova-compute[74421]: INFO nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 23 15:53:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:53:34 user nova-compute[74421]: INFO nova.compute.manager [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Took 5.95 seconds to build instance.
Oct 23 15:53:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-1f03c940-edf7-4fec-b4f9-48ddca1e02cf tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.045s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-26d09fa2-739c-40b7-9a38-43fee4437c69 req-33b52cf5-15aa-4cdc-a416-e377529716eb service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-unplugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-26d09fa2-739c-40b7-9a38-43fee4437c69 req-33b52cf5-15aa-4cdc-a416-e377529716eb service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-26d09fa2-739c-40b7-9a38-43fee4437c69 req-33b52cf5-15aa-4cdc-a416-e377529716eb service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-26d09fa2-739c-40b7-9a38-43fee4437c69 req-33b52cf5-15aa-4cdc-a416-e377529716eb service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG nova.compute.manager [req-26d09fa2-739c-40b7-9a38-43fee4437c69 req-33b52cf5-15aa-4cdc-a416-e377529716eb service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-unplugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:35 user nova-compute[74421]: WARNING nova.compute.manager [req-26d09fa2-739c-40b7-9a38-43fee4437c69 req-33b52cf5-15aa-4cdc-a416-e377529716eb service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-unplugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state active and task_state reboot_started.
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:35 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:53:35 user nova-compute[74421]: INFO nova.compute.claims [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Claim successful on node user
Oct 23 15:53:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.policy [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8decd53c14b49fe8ab2765e7f0c726d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beee00c4721f4f89942da65f6571c1d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:53:36 user nova-compute[74421]: INFO nova.virt.block_device [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Booting with volume ca0ee81f-8bff-40c0-95f1-9dcca0496a55 at /dev/vda
Oct 23 15:53:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance shutdown successfully.
Oct 23 15:53:36 user nova-compute[74421]: DEBUG os_brick.utils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[33300e55-7f4d-41c9-9a16-08fca986d807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc57c02-4d83-4d49-8bc0-67d471010e70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec50dff-38fd-4d46-a8f8-431333efce86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[23547551-9768-4e66-93f1-332aaa797fe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:53:36 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:53:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dedf345-e4a9-47d3-9b66-ff841ef1adc4]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG os_brick.utils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:53:36 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating existing volume attachment record: fd4773ae-8b45-4fd0-b1e2-c605e87d9692 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:53:37 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Successfully created port: 6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:53:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f963238-2bb3-418b-a3c8-3cfa72b158d4 req-592d1fe8-facb-4ab8-b8eb-182720b80bf3 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f963238-2bb3-418b-a3c8-3cfa72b158d4 req-592d1fe8-facb-4ab8-b8eb-182720b80bf3 service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f963238-2bb3-418b-a3c8-3cfa72b158d4 req-592d1fe8-facb-4ab8-b8eb-182720b80bf3 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:37 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7f963238-2bb3-418b-a3c8-3cfa72b158d4 req-592d1fe8-facb-4ab8-b8eb-182720b80bf3 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:37 user nova-compute[74421]: DEBUG nova.compute.manager [req-7f963238-2bb3-418b-a3c8-3cfa72b158d4 req-592d1fe8-facb-4ab8-b8eb-182720b80bf3 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:37 user nova-compute[74421]: WARNING nova.compute.manager [req-7f963238-2bb3-418b-a3c8-3cfa72b158d4 req-592d1fe8-facb-4ab8-b8eb-182720b80bf3 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state active and task_state reboot_started.
Oct 23 15:53:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Successfully updated port: 6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquired lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG nova.network.neutron [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating instance_info_cache with network_info: [{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Releasing lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:38 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Instance network_info: |[{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:39 user nova-compute[74421]: WARNING nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state active and task_state reboot_started.
Oct 23 15:53:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-changed-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Refreshing instance network info cache due to event network-changed-6542a61b-d6ce-49b6-9a97-d0526fc571bb. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Acquiring lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Acquired lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:39 user nova-compute[74421]: DEBUG nova.network.neutron [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Refreshing network info cache for port 6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updated VIF entry in instance network info cache for port 6542a61b-d6ce-49b6-9a97-d0526fc571bb. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating instance_info_cache with network_info: [{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Releasing lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:40 user nova-compute[74421]: WARNING nova.compute.manager [req-915d7e19-7113-49e1-9f5e-b4e424fbd09d req-9c08ea46-f821-479d-9193-6bf81bbd3f4c service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state active and task_state reboot_started.
Oct 23 15:53:40 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance running successfully.
Oct 23 15:53:40 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance soft rebooted successfully.
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6679f0fc-b74a-4472-83a1-9cb071bd42c3 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.857s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-changed-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.compute.manager [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Refreshing instance network info cache due to event network-changed-56f0611e-2643-413c-a8e4-f8df841e0766. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] Acquiring lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] Acquired lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:53:40 user nova-compute[74421]: DEBUG nova.network.neutron [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Refreshing network info cache for port 56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG nova.network.neutron [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updated VIF entry in instance network info cache for port 56f0611e-2643-413c-a8e4-f8df841e0766. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG nova.network.neutron [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updating instance_info_cache with network_info: [{"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-c32008a2-81b9-41d6-939c-9c6f36e3c591 req-52555419-08f4-4fb1-a3e4-05e2c0bb01dc service nova] Releasing lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'flavor' on Instance uuid fe9824d1-80f5-48dc-816a-ba3507ec935c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:41 user nova-compute[74421]: INFO nova.compute.manager [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Attaching volume d5fb8917-da49-44d1-8108-eee1d247f182 to /dev/vdb
Oct 23 15:53:41 user nova-compute[74421]: DEBUG os_brick.utils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[880abbe4-2d72-40b8-908a-b86c14cdedee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065f060-ab6d-469d-ba49-7070196a04d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a6f9fe-6951-45fe-8ac1-d91a658bfc7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e85617-fa35-47ae-9951-b3750aa84e91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:53:41 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:53:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33ea39-861a-4157-92c7-2ece784937b9]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG os_brick.utils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:53:41 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updating existing volume attachment record: 205863ea-eaf1-4b9f-acd4-65094c6d7949 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:53:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:53:54 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Creating image(s)
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Ensure instance console log exists: /opt/stack/data/nova/instances/ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Start _get_guest_xml network_info=[{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'fd4773ae-8b45-4fd0-b1e2-c605e87d9692', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTwZBlmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca0ee81f-8bff-40c0-95f1-9dcca0496a55', 'serial': 'ca0ee81f-8bff-40c0-95f1-9dcca0496a55'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:53:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:53:54 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTwZBlmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:53:54 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:53:54 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:53:54 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba352e-b2b4-410d-bdd9-83e7956d2f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:53:54 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc7d8b4-a843-4536-8874-76fb34dc1eba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55] added
Oct 23 15:53:54 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e59cce-1a74-40b4-9046-5ea2640d7c64]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1eedd6-128e-4b2d-863e-328fcab7d92b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTwZBlmM {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTwZBlmM" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2118a85d-290a-4d79-9a79-fa776eda78da]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RTwZBlmM'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce3a9b-ef64-4bfa-9da1-d3597f4ea63f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c0362-79d0-421a-a716-bbaffdad7a26]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:54 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:54 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fce03d3-996d-4051-8719-9e68c89d9cfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260]
Oct 23 15:53:54 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260] successful.
Oct 23 15:53:54 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a05e4-d682-48e2-ac23-115e20c2e9ae]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[914ae5ce-796b-43ae-91e4-f4252db6a9ac]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:54 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:53:54 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:54 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:53:54 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f0dd0-f3c2-4b3b-be9a-662e0ee64019]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:54 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTwZBlmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26162343537336630', 'path': '/dev/sdc'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162343537336630', 'path': '/dev/sdc'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1034682774',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1034682774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1034682774',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVH4BrZr+qVQ2m9dMZcbvsfiXv6vySseLevT8duvwvr4LgyaIfXYXYCJpH3Pa4PB76xHjQlv9XzKrc0s3xOjfHUr12qUOqNnzURG/q1/Z8XeX65Vy6XZOzm6+uhiogXAw==',key_name='tempest-keypair-1339892157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-8e1xv6ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.objects.instance [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lazy-loading 'pci_devices' on Instance uuid ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:53:55 user nova-compute[74421]:   <uuid>ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13</uuid>
Oct 23 15:53:55 user nova-compute[74421]:   <name>instance-0000002f</name>
Oct 23 15:53:55 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:53:55 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:53:55 user nova-compute[74421]:   <metadata>
Oct 23 15:53:55 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:53:55 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:53:55 user nova-compute[74421]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1034682774</nova:name>
Oct 23 15:53:55 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:53:54</nova:creationTime>
Oct 23 15:53:55 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:53:55 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:53:55 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:53:55 user nova-compute[74421]:       <nova:owner>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:user uuid="d8decd53c14b49fe8ab2765e7f0c726d">tempest-TestVolumeBootPattern-1940666020-project-member</nova:user>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:project uuid="beee00c4721f4f89942da65f6571c1d8">tempest-TestVolumeBootPattern-1940666020</nova:project>
Oct 23 15:53:55 user nova-compute[74421]:       </nova:owner>
Oct 23 15:53:55 user nova-compute[74421]:       <nova:ports>
Oct 23 15:53:55 user nova-compute[74421]:         <nova:port uuid="6542a61b-d6ce-49b6-9a97-d0526fc571bb">
Oct 23 15:53:55 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 15:53:55 user nova-compute[74421]:         </nova:port>
Oct 23 15:53:55 user nova-compute[74421]:       </nova:ports>
Oct 23 15:53:55 user nova-compute[74421]:     </nova:instance>
Oct 23 15:53:55 user nova-compute[74421]:   </metadata>
Oct 23 15:53:55 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:53:55 user nova-compute[74421]:     <system>
Oct 23 15:53:55 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:53:55 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:53:55 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:53:55 user nova-compute[74421]:       <entry name="serial">ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13</entry>
Oct 23 15:53:55 user nova-compute[74421]:       <entry name="uuid">ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13</entry>
Oct 23 15:53:55 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:53:55 user nova-compute[74421]:     </system>
Oct 23 15:53:55 user nova-compute[74421]:   </sysinfo>
Oct 23 15:53:55 user nova-compute[74421]:   <os>
Oct 23 15:53:55 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:53:55 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:53:55 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:53:55 user nova-compute[74421]:   </os>
Oct 23 15:53:55 user nova-compute[74421]:   <features>
Oct 23 15:53:55 user nova-compute[74421]:     <acpi/>
Oct 23 15:53:55 user nova-compute[74421]:     <apic/>
Oct 23 15:53:55 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:53:55 user nova-compute[74421]:   </features>
Oct 23 15:53:55 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:53:55 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:53:55 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:53:55 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:53:55 user nova-compute[74421]:   </clock>
Oct 23 15:53:55 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:53:55 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:53:55 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:53:55 user nova-compute[74421]:   </cpu>
Oct 23 15:53:55 user nova-compute[74421]:   <devices>
Oct 23 15:53:55 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:53:55 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:53:55 user nova-compute[74421]:       <source dev="/dev/sdc"/>
Oct 23 15:53:55 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:53:55 user nova-compute[74421]:       <serial>ca0ee81f-8bff-40c0-95f1-9dcca0496a55</serial>
Oct 23 15:53:55 user nova-compute[74421]:     </disk>
Oct 23 15:53:55 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:53:55 user nova-compute[74421]:       <mac address="fa:16:3e:5c:d1:e8"/>
Oct 23 15:53:55 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:53:55 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:53:55 user nova-compute[74421]:       <target dev="tap6542a61b-d6"/>
Oct 23 15:53:55 user nova-compute[74421]:     </interface>
Oct 23 15:53:55 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:53:55 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13/console.log" append="off"/>
Oct 23 15:53:55 user nova-compute[74421]:     </serial>
Oct 23 15:53:55 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:53:55 user nova-compute[74421]:     <video>
Oct 23 15:53:55 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:53:55 user nova-compute[74421]:     </video>
Oct 23 15:53:55 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:53:55 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:53:55 user nova-compute[74421]:     </rng>
Oct 23 15:53:55 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:53:55 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:53:55 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:53:55 user nova-compute[74421]:     </memballoon>
Oct 23 15:53:55 user nova-compute[74421]:   </devices>
Oct 23 15:53:55 user nova-compute[74421]: </domain>
Oct 23 15:53:55 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1034682774',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1034682774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1034682774',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVH4BrZr+qVQ2m9dMZcbvsfiXv6vySseLevT8duvwvr4LgyaIfXYXYCJpH3Pa4PB76xHjQlv9XzKrc0s3xOjfHUr12qUOqNnzURG/q1/Z8XeX65Vy6XZOzm6+uhiogXAw==',key_name='tempest-keypair-1339892157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-8e1xv6ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG os_vif [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c8d881a-32b4-5733-8584-93fb83f35a77', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6542a61b-d6, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6542a61b-d6, col_values=(('qos', UUID('9b1fce4b-65ff-4d8f-80e2-0cc48b55df9e')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6542a61b-d6, col_values=(('external_ids', {'iface-id': '6542a61b-d6ce-49b6-9a97-d0526fc571bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:d1:e8', 'vm-uuid': 'ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:55 user nova-compute[74421]: INFO os_vif [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6')
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:53:55 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] No VIF found with MAC fa:16:3e:5c:d1:e8, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:53:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-9ca3eb22-2857-4d11-816e-4005bfbb8599 req-4c9b62d4-1699-438f-96dd-e99cd7233187 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9ca3eb22-2857-4d11-816e-4005bfbb8599 req-4c9b62d4-1699-438f-96dd-e99cd7233187 service nova] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9ca3eb22-2857-4d11-816e-4005bfbb8599 req-4c9b62d4-1699-438f-96dd-e99cd7233187 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-9ca3eb22-2857-4d11-816e-4005bfbb8599 req-4c9b62d4-1699-438f-96dd-e99cd7233187 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG nova.compute.manager [req-9ca3eb22-2857-4d11-816e-4005bfbb8599 req-4c9b62d4-1699-438f-96dd-e99cd7233187 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] No waiting events found dispatching network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:57 user nova-compute[74421]: WARNING nova.compute.manager [req-9ca3eb22-2857-4d11-816e-4005bfbb8599 req-4c9b62d4-1699-438f-96dd-e99cd7233187 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received unexpected event network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb for instance with vm_state building and task_state spawning.
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgPDyazt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:53:58 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:53:58 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:53:58 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7681eec9-be24-4876-b599-5ea4ffd24c41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:53:58 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[104ae943-455b-485d-929c-f7cfd3193508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182] added
Oct 23 15:53:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c25b8b4-41e5-4929-98dd-a0096b8f0f1f]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee354b2a-3ba6-4f99-843c-6ce45f84e0df]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgPDyazt {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgPDyazt" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[51530b47-8da9-4bfe-a407-79dbb41d73d3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WgPDyazt'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f79257-6b23-4fca-b000-356b1c0a041e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4775aa1c-8ce3-4614-83a7-73f2e6044853]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:58 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:53:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:58 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:53:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e0ad4-c20e-4176-8bf9-ffee3a56756a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260]
Oct 23 15:53:58 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260] successful.
Oct 23 15:53:58 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:58 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25546f1-85c0-4ece-8b78-34b6161fc85a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b05e11-8a61-4c05-9d05-322463fd4775]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:59 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:53:59 user nova-compute[74421]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 (non-flash)
Oct 23 15:53:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:53:59 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:53:59 user nova-compute[74421]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 (non-flash)
Oct 23 15:53:59 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[09437c2a-6c24-402b-954e-9b98e23bc975]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:53:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Instance spawned successfully.
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:53:59 user nova-compute[74421]: INFO nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Took 4.95 seconds to spawn the instance on the hypervisor.
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:53:59 user nova-compute[74421]: INFO nova.compute.manager [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Took 23.78 seconds to build instance.
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-ded8d10f-1d8d-4753-8e9b-30df681642ff tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.908s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-2801e1ef-df8e-4aef-ba45-9a56916420c5 req-aa09da04-8714-4415-a7d3-bc0dd000ecc5 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2801e1ef-df8e-4aef-ba45-9a56916420c5 req-aa09da04-8714-4415-a7d3-bc0dd000ecc5 service nova] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2801e1ef-df8e-4aef-ba45-9a56916420c5 req-aa09da04-8714-4415-a7d3-bc0dd000ecc5 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-2801e1ef-df8e-4aef-ba45-9a56916420c5 req-aa09da04-8714-4415-a7d3-bc0dd000ecc5 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:53:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-2801e1ef-df8e-4aef-ba45-9a56916420c5 req-aa09da04-8714-4415-a7d3-bc0dd000ecc5 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] No waiting events found dispatching network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:53:59 user nova-compute[74421]: WARNING nova.compute.manager [req-2801e1ef-df8e-4aef-ba45-9a56916420c5 req-aa09da04-8714-4415-a7d3-bc0dd000ecc5 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received unexpected event network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb for instance with vm_state active and task_state None.
Oct 23 15:54:00 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgPDyazt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23933666330386338', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933666330386338', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'flavor' on Instance uuid fe9824d1-80f5-48dc-816a-ba3507ec935c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:54:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:54:00 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:54:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:54:00 user nova-compute[74421]:   <serial>d5fb8917-da49-44d1-8108-eee1d247f182</serial>
Oct 23 15:54:00 user nova-compute[74421]: </disk>
Oct 23 15:54:00 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] No VIF found with MAC fa:16:3e:d5:73:7f, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd20-f466-482b-a64a-b68e0ffe9e34 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.199s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:02 user nova-compute[74421]: INFO nova.compute.manager [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Detaching volume d5fb8917-da49-44d1-8108-eee1d247f182
Oct 23 15:54:02 user nova-compute[74421]: INFO nova.virt.block_device [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Attempting to driver detach volume d5fb8917-da49-44d1-8108-eee1d247f182 from mountpoint /dev/vdb
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Attempting to detach device vdb from instance fe9824d1-80f5-48dc-816a-ba3507ec935c from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:54:02 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:54:02 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:54:02 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:54:02 user nova-compute[74421]:   <serial>d5fb8917-da49-44d1-8108-eee1d247f182</serial>
Oct 23 15:54:02 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:54:02 user nova-compute[74421]: </disk>
Oct 23 15:54:02 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:54:02 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully detached device vdb from instance fe9824d1-80f5-48dc-816a-ba3507ec935c from the persistent domain config.
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe9824d1-80f5-48dc-816a-ba3507ec935c from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:54:02 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:54:02 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:54:02 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:54:02 user nova-compute[74421]:   <serial>d5fb8917-da49-44d1-8108-eee1d247f182</serial>
Oct 23 15:54:02 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:54:02 user nova-compute[74421]: </disk>
Oct 23 15:54:02 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe9824d1-80f5-48dc-816a-ba3507ec935c {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:54:02 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:54:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:05 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:54:05 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=24.784664154052734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance fe9824d1-80f5-48dc-816a-ba3507ec935c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:54:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:06 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:54:06 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:54:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:54:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:11 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:54:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:16 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:54:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:22 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe9824d1-80f5-48dc-816a-ba3507ec935c is timed out.
Oct 23 15:54:22 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully detached device vdb from instance fe9824d1-80f5-48dc-816a-ba3507ec935c from the live domain config.
Oct 23 15:54:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgPDyazt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:54:22 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb525c97-9d67-477c-a4f3-d6574951c9bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:54:22 user nova-compute[74421]: No targets found.
Oct 23 15:54:22 user nova-compute[74421]: iSNS:
Oct 23 15:54:22 user nova-compute[74421]: No targets found.
Oct 23 15:54:22 user nova-compute[74421]: STATIC:
Oct 23 15:54:22 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605
Oct 23 15:54:22 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:54:22 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:54:22 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55
Oct 23 15:54:22 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:54:22 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:54:22 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182
Oct 23 15:54:22 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:54:22 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:54:22 user nova-compute[74421]: FIRMWARE:
Oct 23 15:54:22 user nova-compute[74421]: No targets found.
Oct 23 15:54:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:54:22 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:54:22 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a557f6b7-fa6b-4bdd-81b2-76327070b315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b58f1-0e4e-4045-b26e-b1ed07768729]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:54:22 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:54:22 user nova-compute[74421]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 (non-flash)
Oct 23 15:54:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:54:22 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:54:22 user nova-compute[74421]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 (non-flash)
Oct 23 15:54:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478205360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b44975-2bc1-4b94-922d-7926f9cfde8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac31c6-9b81-4c22-88bc-86c882422013]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0b6f19-eeb7-4f51-b640-73d1294b1774]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a648ace-527b-426a-9ec5-a405ad4cf3fc]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12640b8-0a96-45a7-a0f8-6728d709fe9c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea1fa3e-221e-4eb8-bb76-7e083fedabff]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260]
Oct 23 15:54:22 user nova-compute[74421]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182, portal: 172.16.0.220,3260] successful.
Oct 23 15:54:22 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fb8917-da49-44d1-8108-eee1d247f182 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[970bbb93-71c9-4ee9-9b16-89fffe0b25aa]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] <== disconnect_volume: return (317ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:54:22 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:54:23 user nova-compute[74421]: DEBUG nova.objects.instance [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'flavor' on Instance uuid fe9824d1-80f5-48dc-816a-ba3507ec935c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:54:23 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-bf2ddd3a-180e-4fc7-b6d1-846e29686c2d tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:54:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:54:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:54:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:54:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:54:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:54:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:54:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:54:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-changed-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG nova.compute.manager [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Refreshing instance network info cache due to event network-changed-56f0611e-2643-413c-a8e4-f8df841e0766. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] Acquiring lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] Acquired lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG nova.network.neutron [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Refreshing network info cache for port 56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:52 user nova-compute[74421]: INFO nova.compute.manager [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Terminating instance
Oct 23 15:54:52 user nova-compute[74421]: DEBUG nova.compute.manager [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updated VIF entry in instance network info cache for port 56f0611e-2643-413c-a8e4-f8df841e0766. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.network.neutron [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updating instance_info_cache with network_info: [{"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bd66610e-6adc-4225-88dc-6c2b60679223 req-c1cbcc90-8a12-4cf0-a5ea-ad601e6b375c service nova] Releasing lock "refresh_cache-fe9824d1-80f5-48dc-816a-ba3507ec935c" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-b563ddea-b91e-4db6-9ad6-f4fdf72cff0a req-7ae452e9-e400-4727-90e0-0db6573dbe91 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-unplugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b563ddea-b91e-4db6-9ad6-f4fdf72cff0a req-7ae452e9-e400-4727-90e0-0db6573dbe91 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b563ddea-b91e-4db6-9ad6-f4fdf72cff0a req-7ae452e9-e400-4727-90e0-0db6573dbe91 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b563ddea-b91e-4db6-9ad6-f4fdf72cff0a req-7ae452e9-e400-4727-90e0-0db6573dbe91 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-b563ddea-b91e-4db6-9ad6-f4fdf72cff0a req-7ae452e9-e400-4727-90e0-0db6573dbe91 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-unplugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.compute.manager [req-b563ddea-b91e-4db6-9ad6-f4fdf72cff0a req-7ae452e9-e400-4727-90e0-0db6573dbe91 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-unplugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Instance destroyed successfully.
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'resources' on Instance uuid fe9824d1-80f5-48dc-816a-ba3507ec935c {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1883773447',display_name='tempest-TestStampPattern-server-1883773447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1883773447',id=45,image_ref='cf9984b4-c94e-41b1-a86e-9856e75e5a8a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDVqurofzLMZNAaghRQtpJ19oylFKFhcxcqMDmzqCiNpsP1f695EadLkKhqxpHR8kS2jYtqlGFt0+J9RecbAT98pcr/b42YIaDLq3lZwwq4BIP60C4+g0H7X1GAdN6Bw==',key_name='tempest-TestStampPattern-1526100776',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6441b3c331748b5b2203328b2595f37',ramdisk_id='',reservation_id='r-fw08m2o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f',image_min_disk='1',image_min_ram='0',image_owner_id='f6441b3c331748b5b2203328b2595f37',image_owner_project_name='tempest-TestStampPattern-320376849',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-320376849-project-member',image_user_id='dbea674c96a747fd9517812e6800a19f',owner_project_name='tempest-TestStampPattern-320376849',owner_user_name='tempest-TestStampPattern-320376849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:51:57Z,user_data=None,user_id='dbea674c96a747fd9517812e6800a19f',uuid=fe9824d1-80f5-48dc-816a-ba3507ec935c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converting VIF {"id": "56f0611e-2643-413c-a8e4-f8df841e0766", "address": "fa:16:3e:d5:73:7f", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f0611e-26", "ovs_interfaceid": "56f0611e-2643-413c-a8e4-f8df841e0766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG os_vif [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56f0611e-26, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd11750e-a41b-467f-bf4e-4ec499e8e91a) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:53 user nova-compute[74421]: INFO os_vif [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:73:7f,bridge_name='br-int',has_traffic_filtering=True,id=56f0611e-2643-413c-a8e4-f8df841e0766,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56f0611e-26')
Oct 23 15:54:53 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Deleting instance files /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c_del
Oct 23 15:54:53 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Deletion of /opt/stack/data/nova/instances/fe9824d1-80f5-48dc-816a-ba3507ec935c_del complete
Oct 23 15:54:53 user nova-compute[74421]: INFO nova.compute.manager [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 15:54:53 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:54:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:54:54 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Took 0.50 seconds to deallocate network for instance.
Oct 23 15:54:54 user nova-compute[74421]: DEBUG nova.compute.manager [req-5a1cc1f5-6b07-4759-b55f-e96e61a214e3 req-cc324505-9747-4a17-a766-bfae0fd0ae3e service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-deleted-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:54:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:54 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Deleted allocations for instance fe9824d1-80f5-48dc-816a-ba3507ec935c
Oct 23 15:54:54 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6fdf8315-b4f6-4a14-a56e-33fbda8961f9 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:54:55 user nova-compute[74421]: WARNING nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state deleted and task_state None.
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:54:55 user nova-compute[74421]: WARNING nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state deleted and task_state None.
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:54:55 user nova-compute[74421]: WARNING nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state deleted and task_state None.
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-unplugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-unplugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:54:55 user nova-compute[74421]: WARNING nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-unplugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state deleted and task_state None.
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Acquiring lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] Lock "fe9824d1-80f5-48dc-816a-ba3507ec935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:54:55 user nova-compute[74421]: DEBUG nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] No waiting events found dispatching network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:54:55 user nova-compute[74421]: WARNING nova.compute.manager [req-73e15d52-eacf-4199-b6a7-3691106f0eec req-3bb8f3dd-d73c-4999-a371-9238d09055b4 service nova] [instance: fe9824d1-80f5-48dc-816a-ba3507ec935c] Received unexpected event network-vif-plugged-56f0611e-2643-413c-a8e4-f8df841e0766 for instance with vm_state deleted and task_state None.
Oct 23 15:54:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:55:03 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:55:05 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:55:05 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8521MB free_disk=24.784687042236328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:55:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:08 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:55:16 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:55:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:55:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-changed-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG nova.compute.manager [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Refreshing instance network info cache due to event network-changed-165b1d15-62cb-42df-a1ec-6f822b4fd6d9. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] Acquiring lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] Acquired lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Refreshing network info cache for port 165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updated VIF entry in instance network info cache for port 165b1d15-62cb-42df-a1ec-6f822b4fd6d9. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG nova.network.neutron [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updating instance_info_cache with network_info: [{"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:55:20 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-20c856cf-a965-4558-adbc-aafd10514edc req-c0da61fc-2c7a-45b6-a850-fb2da0274084 service nova] Releasing lock "refresh_cache-bf08160e-b7c2-41d8-ae07-b645570dcfb8" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:55:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:55:24 user nova-compute[74421]: DEBUG nova.compute.manager [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing instance network info cache due to event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:55:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:55:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:55:24 user nova-compute[74421]: DEBUG nova.network.neutron [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated VIF entry in instance network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.network.neutron [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-16d8ea9e-3259-4b89-9862-e12ffac7fdf7 req-95edc0a7-93e3-47e5-a737-d49fefe4eee1 service nova] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:25 user nova-compute[74421]: INFO nova.compute.manager [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Detaching volume e6d96309-77dd-4457-9e8d-9d0e8c492605
Oct 23 15:55:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:55:25 user nova-compute[74421]: INFO nova.virt.block_device [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Attempting to driver detach volume e6d96309-77dd-4457-9e8d-9d0e8c492605 from mountpoint /dev/vdb
Oct 23 15:55:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Attempting to detach device vdb from instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:55:25 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:55:25 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:55:25 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:55:25 user nova-compute[74421]:   <serial>e6d96309-77dd-4457-9e8d-9d0e8c492605</serial>
Oct 23 15:55:25 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:55:25 user nova-compute[74421]: </disk>
Oct 23 15:55:25 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:55:25 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully detached device vdb from instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 from the persistent domain config.
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:55:25 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:55:25 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:55:25 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 15:55:25 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:55:25 user nova-compute[74421]:   <serial>e6d96309-77dd-4457-9e8d-9d0e8c492605</serial>
Oct 23 15:55:25 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:55:25 user nova-compute[74421]: </disk>
Oct 23 15:55:25 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:26 user nova-compute[74421]: INFO nova.compute.manager [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attaching volume 6150565c-6ef1-47a3-9526-1bbc5b01f3a0 to /dev/vdb
Oct 23 15:55:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG os_brick.utils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a887c32-e183-40c0-a13e-4a6de9347468]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[67146630-1cc6-4aee-8ae5-2ab5edbb8a85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0dc3e-d178-4699-abf4-5e38f3d55c8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f75ede-760c-4e0d-b253-3a28ed699024]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:55:26 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db7a8aa-aaa7-45f8-bde8-b4ca573ed5ca]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG os_brick.utils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updating existing volume attachment record: 0a6e9e99-66c5-460a-923f-bcfec3093fb8 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing instance network info cache due to event network-changed-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:55:26 user nova-compute[74421]: DEBUG nova.network.neutron [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Refreshing network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated VIF entry in instance network info cache for port eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-changed-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Refreshing instance network info cache due to event network-changed-6542a61b-d6ce-49b6-9a97-d0526fc571bb. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] Acquiring lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] Acquired lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Refreshing network info cache for port 6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updated VIF entry in instance network info cache for port 6542a61b-d6ce-49b6-9a97-d0526fc571bb. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG nova.network.neutron [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating instance_info_cache with network_info: [{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:55:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-8b00a0e1-c217-4883-9118-92c25adc7ec7 req-220bf893-915a-4623-b877-429c651665c4 service nova] Releasing lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:55:28 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:33 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:38 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:55:40 user nova-compute[74421]: INFO nova.compute.claims [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Claim successful on node user
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:55:40 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:55:40 user nova-compute[74421]: INFO nova.virt.block_device [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Booting with volume snapshot b4cccb2f-2036-48bc-b64c-b27a11e05101 at /dev/vda
Oct 23 15:55:40 user nova-compute[74421]: DEBUG nova.policy [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8decd53c14b49fe8ab2765e7f0c726d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beee00c4721f4f89942da65f6571c1d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:55:41 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Successfully created port: 8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Successfully updated port: 8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquired lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-changed-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.compute.manager [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Refreshing instance network info cache due to event network-changed-8a93b03f-540a-431b-b6e6-0c1d1a7db31f. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] Acquiring lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updating instance_info_cache with network_info: [{"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Releasing lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Instance network_info: |[{"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] Acquired lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Refreshing network info cache for port 8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updated VIF entry in instance network info cache for port 8a93b03f-540a-431b-b6e6-0c1d1a7db31f. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG nova.network.neutron [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updating instance_info_cache with network_info: [{"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:55:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-a6aa8e33-830b-428d-83b8-c09f9e612975 req-bd535f97-3e7d-4bf9-a892-334b3415677e service nova] Releasing lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKBLvels', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:55:43 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:55:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:55:43 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:55:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:55:43 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:55:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5e521-1a29-4685-af33-bd975e77b89c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:55:43 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:43 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[551a000b-376b-466f-8b48-27251c3b2e80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0] added
Oct 23 15:55:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527c597-7f1e-4b7b-af51-6f7cd263b11b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f423d05d-7810-4ec8-9c51-6c2b6b0af351]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKBLvels {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKBLvels" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b054ed-6031-4ac7-b083-9fcfe527e6fd]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKBLvels'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a726f-7e71-4f2e-97f0-07934aa73169]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe35dd-0486-429b-a7de-447d03dd801c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef5e1a-5963-49ad-9bab-7ec0767c0738]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260]
Oct 23 15:55:44 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260] successful.
Oct 23 15:55:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5bfc5f-c1c7-4c9f-beba-0df05cd8956c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f92bf-207a-450b-88b1-904a77d7f0ea]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:55:44 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f093ab80-c11f-4bac-9c2f-a378c5f0ccda]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:55:44 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKBLvels', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23533646263663564', 'path': '/dev/sdd'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533646263663564', 'path': '/dev/sdd'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:55:45 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:55:45 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:55:45 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:55:45 user nova-compute[74421]:   <serial>6150565c-6ef1-47a3-9526-1bbc5b01f3a0</serial>
Oct 23 15:55:45 user nova-compute[74421]: </disk>
Oct 23 15:55:45 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No VIF found with MAC fa:16:3e:0e:e1:77, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:55:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a018d586-7abf-41b7-b983-bad57d5ca558 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.807s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:46 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 is timed out.
Oct 23 15:55:46 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully detached device vdb from instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 from the live domain config.
Oct 23 15:55:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuIACrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:55:46 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce017ce8-c6d3-4dd9-ba49-042f2d18e1d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:55:46 user nova-compute[74421]: No targets found.
Oct 23 15:55:46 user nova-compute[74421]: iSNS:
Oct 23 15:55:46 user nova-compute[74421]: No targets found.
Oct 23 15:55:46 user nova-compute[74421]: STATIC:
Oct 23 15:55:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0
Oct 23 15:55:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:55:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:55:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605
Oct 23 15:55:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:55:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:55:46 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55
Oct 23 15:55:46 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:55:46 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:55:46 user nova-compute[74421]: FIRMWARE:
Oct 23 15:55:46 user nova-compute[74421]: No targets found.
Oct 23 15:55:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:55:46 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:55:46 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[96898259-4325-4a7c-9a45-b2aae51abccb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a66fc35-4163-4b76-a3a4-f9bac127ef09]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:55:46 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:55:46 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:55:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 (non-flash)
Oct 23 15:55:46 user nova-compute[74421]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:55:46 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:55:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2478134940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954835a-0bae-4efe-a8de-08cc0725a426]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f206e-42f0-4bed-97d2-7f5dce6ed212]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb87f56-ecb3-4a5b-83d7-bd800105bbbd]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea0fcf-57d3-4b00-86bb-c49209e3e2c4]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f3a1a-f005-4ae0-98bf-4b2ca592a4ba]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.utils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e20dcd-cc63-4871-9943-1c96a4e89a7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[839af5bb-49b3-4ed4-947e-e32978c4091c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5257423-7d6f-4f2b-bdc8-7e946e167149]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260]
Oct 23 15:55:46 user nova-compute[74421]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605, portal: 172.16.0.220,3260] successful.
Oct 23 15:55:46 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf5dbb3-0da7-4a7d-b1a8-c12d86b8b312]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbedc33-f555-465e-8838-b3ef11d7f9fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d96309-77dd-4457-9e8d-9d0e8c492605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e3b72-c0bd-45f7-b290-3205c247d6b7]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] <== disconnect_volume: return (343ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:55:46 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:55:46 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[845eae9c-e8f8-4ffb-a7a2-99e1e7692bb6]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG os_brick.utils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:55:46 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updating existing volume attachment record: 2080d00a-35be-43ab-8110-2c637091af08 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:55:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:51 user nova-compute[74421]: DEBUG nova.objects.instance [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'flavor' on Instance uuid d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:55:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-52ceb697-89ef-4486-9a98-6aa07bd584fa tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.105s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:55:52 user nova-compute[74421]: INFO nova.compute.manager [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attaching volume 5590649c-d4db-4738-a460-2c3ef8ed4621 to /dev/vdc
Oct 23 15:55:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cc329-94c3-4bdd-b964-132006fc389a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e914c54e-ebb3-4a4b-ab01-bff2f97089bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedad3b9-b9f4-480b-b018-8e61c138e451]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0d485c-5f7c-4af5-b076-7cea03ed5fbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:55:52 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:55:52 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88207b2-8686-4439-9745-626453ae3c9a]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG os_brick.utils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:55:52 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updating existing volume attachment record: d5993f6c-e5f7-49fe-95f4-773136335a53 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:55:53 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:55:58 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:02 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-changed-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Refreshing instance network info cache due to event network-changed-97268cc8-85ca-47ce-9384-305fc8089c35. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] Acquiring lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] Acquired lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.network.neutron [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Refreshing network info cache for port 97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:03 user nova-compute[74421]: INFO nova.compute.manager [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Terminating instance
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Skipping network cache update for instance because it is being deleted. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Skipping network cache update for instance because it is Building. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-7ef5bd92-c059-4dad-97de-6f5b34a1f1dd req-362be9fe-1019-433b-9392-c5232cdf67b8 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-vif-unplugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7ef5bd92-c059-4dad-97de-6f5b34a1f1dd req-362be9fe-1019-433b-9392-c5232cdf67b8 service nova] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7ef5bd92-c059-4dad-97de-6f5b34a1f1dd req-362be9fe-1019-433b-9392-c5232cdf67b8 service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7ef5bd92-c059-4dad-97de-6f5b34a1f1dd req-362be9fe-1019-433b-9392-c5232cdf67b8 service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-7ef5bd92-c059-4dad-97de-6f5b34a1f1dd req-362be9fe-1019-433b-9392-c5232cdf67b8 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] No waiting events found dispatching network-vif-unplugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:03 user nova-compute[74421]: DEBUG nova.compute.manager [req-7ef5bd92-c059-4dad-97de-6f5b34a1f1dd req-362be9fe-1019-433b-9392-c5232cdf67b8 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-vif-unplugged-97268cc8-85ca-47ce-9384-305fc8089c35 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updated VIF entry in instance network info cache for port 97268cc8-85ca-47ce-9384-305fc8089c35. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.neutron [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [{"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-7bc642d5-af07-4973-81f4-6c751b062315 req-14f7e2ca-d8f1-4e47-95dc-79253c091895 service nova] Releasing lock "refresh_cache-358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [{"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-d31bcfcf-56bd-45b3-b01a-13371fb36cb2" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:56:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Instance destroyed successfully.
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.objects.instance [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lazy-loading 'resources' on Instance uuid 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1502763980',display_name='tempest-TestStampPattern-server-1502763980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1502763980',id=42,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDVqurofzLMZNAaghRQtpJ19oylFKFhcxcqMDmzqCiNpsP1f695EadLkKhqxpHR8kS2jYtqlGFt0+J9RecbAT98pcr/b42YIaDLq3lZwwq4BIP60C4+g0H7X1GAdN6Bw==',key_name='tempest-TestStampPattern-1526100776',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6441b3c331748b5b2203328b2595f37',ramdisk_id='',reservation_id='r-4aesdme8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-320376849',owner_user_name='tempest-TestStampPattern-320376849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:51:47Z,user_data=None,user_id='dbea674c96a747fd9517812e6800a19f',uuid=358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converting VIF {"id": "97268cc8-85ca-47ce-9384-305fc8089c35", "address": "fa:16:3e:22:53:55", "network": {"id": "6a126474-cb29-4bcc-9a76-1167b30d0c7e", "bridge": "br-int", "label": "tempest-TestStampPattern-2019340013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6441b3c331748b5b2203328b2595f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97268cc8-85", "ovs_interfaceid": "97268cc8-85ca-47ce-9384-305fc8089c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_vif [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97268cc8-85, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7f26315-8b29-48b7-a655-adb33a84d7ed) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:04 user nova-compute[74421]: INFO os_vif [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:53:55,bridge_name='br-int',has_traffic_filtering=True,id=97268cc8-85ca-47ce-9384-305fc8089c35,network=Network(6a126474-cb29-4bcc-9a76-1167b30d0c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97268cc8-85')
Oct 23 15:56:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Deleting instance files /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f_del
Oct 23 15:56:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Deletion of /opt/stack/data/nova/instances/358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f_del complete
Oct 23 15:56:04 user nova-compute[74421]: INFO nova.compute.manager [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 15:56:04 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Creating image(s)
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Did not create local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Ensure instance console log exists: /opt/stack/data/nova/instances/1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Start _get_guest_xml network_info=[{"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-23T15:55:28Z,direct_url=<?>,disk_format='qcow2',id=7e1fa5b4-fbd6-455e-aff9-730f266d34e3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1294313116',owner='beee00c4721f4f89942da65f6571c1d8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-23T15:55:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '2080d00a-35be-43ab-8110-2c637091af08', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUmwVGzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85', 'attached_at': '', 'detached_at': '', 'volume_id': '887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb', 'serial': '887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb'}, 'boot_index': 0, 'volume_type': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 15:56:04 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:56:04 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-23T15:55:28Z,direct_url=<?>,disk_format='qcow2',id=7e1fa5b4-fbd6-455e-aff9-730f266d34e3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1294313116',owner='beee00c4721f4f89942da65f6571c1d8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-23T15:55:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUmwVGzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:56:04 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:56:04 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:56:04 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca93f8db-ac7d-42a3-9dc0-4e8e1966ecf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:56:04 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c914edc2-6e25-4f33-a007-97168f1ec3d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb] added
Oct 23 15:56:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf97f753-de5c-4299-8e71-3252063540a0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d039859a-cb14-491c-9fdb-3567e5b0925d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUmwVGzs {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUmwVGzs" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f360019-22bf-40f3-add4-d5342eb8e74e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CUmwVGzs'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f6ada9-88c3-49d5-abee-20e704bedaad]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d9dba4-809f-4fa1-8a9e-ae158c368676]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04284831-0b85-4b79-befc-1a31e8be8c15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260]
Oct 23 15:56:04 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260] successful.
Oct 23 15:56:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2656aed6-0dea-4782-a642-c8c7a54ce459]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a3824-ec38-408f-8170-61e174827c1e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:04 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:04 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[339c4a79-837c-471d-b3a4-1ff912f5e606]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUmwVGzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:56:04 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:04 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Took 0.49 seconds to deallocate network for instance.
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:05 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Deleted allocations for instance 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-db13ad4c-e378-4ed2-ac25-2f4c6079cbf1 tempest-TestStampPattern-320376849 tempest-TestStampPattern-320376849-project-member] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-35ebd15c-9f45-4786-a197-090e9a0cbfe2 req-0e876beb-38b4-4493-b275-712ed4a577d8 service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-vif-deleted-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:05 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26266333763373238', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266333763373238', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ad003d8-92c7-469a-a62b-a75498d313a0 req-33d8bc39-50a7-483d-98b4-e0166b60775f service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received event network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ad003d8-92c7-469a-a62b-a75498d313a0 req-33d8bc39-50a7-483d-98b4-e0166b60775f service nova] Acquiring lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ad003d8-92c7-469a-a62b-a75498d313a0 req-33d8bc39-50a7-483d-98b4-e0166b60775f service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ad003d8-92c7-469a-a62b-a75498d313a0 req-33d8bc39-50a7-483d-98b4-e0166b60775f service nova] Lock "358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ad003d8-92c7-469a-a62b-a75498d313a0 req-33d8bc39-50a7-483d-98b4-e0166b60775f service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] No waiting events found dispatching network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:06 user nova-compute[74421]: WARNING nova.compute.manager [req-1ad003d8-92c7-469a-a62b-a75498d313a0 req-33d8bc39-50a7-483d-98b4-e0166b60775f service nova] [instance: 358f5502-3d3b-4c6c-96c9-ae2ff72b0f0f] Received unexpected event network-vif-plugged-97268cc8-85ca-47ce-9384-305fc8089c35 for instance with vm_state deleted and task_state None.
Oct 23 15:56:06 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:56:06 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=24.90758514404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-709444670',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-709444670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-709444670',id=48,image_ref='7e1fa5b4-fbd6-455e-aff9-730f266d34e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjjJ0AgiPWJjNcXyrSjy/1JPLbrXbfzX2B1UjzsuupkVrE85ph8XX3VjZ3ZTKk7T61Qb9BqQe51QXJzFj4SN0Y/QcICklF1k/zNyyzqseCzo3LOTPy29jbhCMDltzA3wA==',key_name='tempest-keypair-1955277539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-0wk0wuv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1940666020',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.objects.instance [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] End _get_guest_xml xml=<domain type="kvm">
Oct 23 15:56:06 user nova-compute[74421]:   <uuid>1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85</uuid>
Oct 23 15:56:06 user nova-compute[74421]:   <name>instance-00000030</name>
Oct 23 15:56:06 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 15:56:06 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 15:56:06 user nova-compute[74421]:   <metadata>
Oct 23 15:56:06 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 15:56:06 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 15:56:06 user nova-compute[74421]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-709444670</nova:name>
Oct 23 15:56:06 user nova-compute[74421]:       <nova:creationTime>2023-10-23 15:56:04</nova:creationTime>
Oct 23 15:56:06 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 15:56:06 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 15:56:06 user nova-compute[74421]:       </nova:flavor>
Oct 23 15:56:06 user nova-compute[74421]:       <nova:owner>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:user uuid="d8decd53c14b49fe8ab2765e7f0c726d">tempest-TestVolumeBootPattern-1940666020-project-member</nova:user>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:project uuid="beee00c4721f4f89942da65f6571c1d8">tempest-TestVolumeBootPattern-1940666020</nova:project>
Oct 23 15:56:06 user nova-compute[74421]:       </nova:owner>
Oct 23 15:56:06 user nova-compute[74421]:       <nova:root type="image" uuid="7e1fa5b4-fbd6-455e-aff9-730f266d34e3"/>
Oct 23 15:56:06 user nova-compute[74421]:       <nova:ports>
Oct 23 15:56:06 user nova-compute[74421]:         <nova:port uuid="8a93b03f-540a-431b-b6e6-0c1d1a7db31f">
Oct 23 15:56:06 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 15:56:06 user nova-compute[74421]:         </nova:port>
Oct 23 15:56:06 user nova-compute[74421]:       </nova:ports>
Oct 23 15:56:06 user nova-compute[74421]:     </nova:instance>
Oct 23 15:56:06 user nova-compute[74421]:   </metadata>
Oct 23 15:56:06 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 15:56:06 user nova-compute[74421]:     <system>
Oct 23 15:56:06 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 15:56:06 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 15:56:06 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 15:56:06 user nova-compute[74421]:       <entry name="serial">1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85</entry>
Oct 23 15:56:06 user nova-compute[74421]:       <entry name="uuid">1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85</entry>
Oct 23 15:56:06 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 15:56:06 user nova-compute[74421]:     </system>
Oct 23 15:56:06 user nova-compute[74421]:   </sysinfo>
Oct 23 15:56:06 user nova-compute[74421]:   <os>
Oct 23 15:56:06 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 15:56:06 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 15:56:06 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 15:56:06 user nova-compute[74421]:   </os>
Oct 23 15:56:06 user nova-compute[74421]:   <features>
Oct 23 15:56:06 user nova-compute[74421]:     <acpi/>
Oct 23 15:56:06 user nova-compute[74421]:     <apic/>
Oct 23 15:56:06 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 15:56:06 user nova-compute[74421]:   </features>
Oct 23 15:56:06 user nova-compute[74421]:   <clock offset="utc">
Oct 23 15:56:06 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 15:56:06 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 15:56:06 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 15:56:06 user nova-compute[74421]:   </clock>
Oct 23 15:56:06 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 15:56:06 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 15:56:06 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 15:56:06 user nova-compute[74421]:   </cpu>
Oct 23 15:56:06 user nova-compute[74421]:   <devices>
Oct 23 15:56:06 user nova-compute[74421]:     <disk type="block" device="disk">
Oct 23 15:56:06 user nova-compute[74421]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:56:06 user nova-compute[74421]:       <source dev="/dev/sdb"/>
Oct 23 15:56:06 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 15:56:06 user nova-compute[74421]:       <serial>887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb</serial>
Oct 23 15:56:06 user nova-compute[74421]:     </disk>
Oct 23 15:56:06 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 15:56:06 user nova-compute[74421]:       <mac address="fa:16:3e:56:0c:6f"/>
Oct 23 15:56:06 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:56:06 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 15:56:06 user nova-compute[74421]:       <target dev="tap8a93b03f-54"/>
Oct 23 15:56:06 user nova-compute[74421]:     </interface>
Oct 23 15:56:06 user nova-compute[74421]:     <serial type="pty">
Oct 23 15:56:06 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85/console.log" append="off"/>
Oct 23 15:56:06 user nova-compute[74421]:     </serial>
Oct 23 15:56:06 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 15:56:06 user nova-compute[74421]:     <video>
Oct 23 15:56:06 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 15:56:06 user nova-compute[74421]:     </video>
Oct 23 15:56:06 user nova-compute[74421]:     <rng model="virtio">
Oct 23 15:56:06 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 15:56:06 user nova-compute[74421]:     </rng>
Oct 23 15:56:06 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 15:56:06 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 15:56:06 user nova-compute[74421]:       <stats period="10"/>
Oct 23 15:56:06 user nova-compute[74421]:     </memballoon>
Oct 23 15:56:06 user nova-compute[74421]:   </devices>
Oct 23 15:56:06 user nova-compute[74421]: </domain>
Oct 23 15:56:06 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-709444670',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-709444670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-709444670',id=48,image_ref='7e1fa5b4-fbd6-455e-aff9-730f266d34e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjjJ0AgiPWJjNcXyrSjy/1JPLbrXbfzX2B1UjzsuupkVrE85ph8XX3VjZ3ZTKk7T61Qb9BqQe51QXJzFj4SN0Y/QcICklF1k/zNyyzqseCzo3LOTPy29jbhCMDltzA3wA==',key_name='tempest-keypair-1955277539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-0wk0wuv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1940666020',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG os_vif [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f5731d2-4875-56ac-a3b9-50c6c96e93be', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a93b03f-54, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a93b03f-54, col_values=(('qos', UUID('a2498656-7388-42af-b27c-6e56b46d495c')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a93b03f-54, col_values=(('external_ids', {'iface-id': '8a93b03f-540a-431b-b6e6-0c1d1a7db31f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:0c:6f', 'vm-uuid': '1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:56:06 user nova-compute[74421]: INFO os_vif [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54')
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] No VIF found with MAC fa:16:3e:56:0c:6f, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:56:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0e4bc71a-1a49-46be-a2b3-f0f1dbedba6b req-eed9d2d6-9819-49b8-9e17-2f4dbe2f3389 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0e4bc71a-1a49-46be-a2b3-f0f1dbedba6b req-eed9d2d6-9819-49b8-9e17-2f4dbe2f3389 service nova] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0e4bc71a-1a49-46be-a2b3-f0f1dbedba6b req-eed9d2d6-9819-49b8-9e17-2f4dbe2f3389 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-0e4bc71a-1a49-46be-a2b3-f0f1dbedba6b req-eed9d2d6-9819-49b8-9e17-2f4dbe2f3389 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-0e4bc71a-1a49-46be-a2b3-f0f1dbedba6b req-eed9d2d6-9819-49b8-9e17-2f4dbe2f3389 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] No waiting events found dispatching network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:07 user nova-compute[74421]: WARNING nova.compute.manager [req-0e4bc71a-1a49-46be-a2b3-f0f1dbedba6b req-eed9d2d6-9819-49b8-9e17-2f4dbe2f3389 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received unexpected event network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f for instance with vm_state building and task_state spawning.
Oct 23 15:56:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 15:56:09 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Instance spawned successfully.
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 15:56:09 user nova-compute[74421]: INFO nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 15:56:09 user nova-compute[74421]: INFO nova.compute.manager [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Took 29.38 seconds to build instance.
Oct 23 15:56:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-e01e1bda-8cd3-4693-a318-0f7293c0a22f tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.533s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-528acf73-c6ce-47f9-83cf-c57b4e9498ce req-ed4a965b-eb10-49de-912c-20b50d3d7ce4 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-528acf73-c6ce-47f9-83cf-c57b4e9498ce req-ed4a965b-eb10-49de-912c-20b50d3d7ce4 service nova] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-528acf73-c6ce-47f9-83cf-c57b4e9498ce req-ed4a965b-eb10-49de-912c-20b50d3d7ce4 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-528acf73-c6ce-47f9-83cf-c57b4e9498ce req-ed4a965b-eb10-49de-912c-20b50d3d7ce4 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:09 user nova-compute[74421]: DEBUG nova.compute.manager [req-528acf73-c6ce-47f9-83cf-c57b4e9498ce req-ed4a965b-eb10-49de-912c-20b50d3d7ce4 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] No waiting events found dispatching network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:09 user nova-compute[74421]: WARNING nova.compute.manager [req-528acf73-c6ce-47f9-83cf-c57b4e9498ce req-ed4a965b-eb10-49de-912c-20b50d3d7ce4 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received unexpected event network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f for instance with vm_state active and task_state None.
Oct 23 15:56:10 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpvEUOHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:56:10 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:56:10 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:56:10 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c2e40d-ea5c-423e-aa78-1b5d1daf4e88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 15:56:10 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea73337-1beb-48e7-a446-5b5680bbc221]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621] added
Oct 23 15:56:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c00960-3e6f-43fb-a1ee-988534cce403]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e2bcb0-a159-4324-8646-b697eec6aaaf]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpvEUOHe {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpvEUOHe" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24641068-38d5-4f2d-8de5-df45c211d971]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpvEUOHe'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b75424-ffc6-4a89-93c0-98840913215d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d6e999-9cab-460e-a64b-e5962163d925]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaba1cef-bc16-485c-9397-065e93892895]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260]
Oct 23 15:56:10 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260] successful.
Oct 23 15:56:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f80fa3-2ef7-4f99-b76b-0150ea9f1776]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[045f8e9a-f89a-4989-9859-3e39dc5116a7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:10 user nova-compute[74421]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)
Oct 23 15:56:10 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80fd7a5-5acb-4462-9339-293ddcf8f482]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 15:56:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpvEUOHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23664383231343135', 'path': '/dev/sde'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664383231343135', 'path': '/dev/sde'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 15:56:11 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:56:11 user nova-compute[74421]:   <source dev="/dev/sde"/>
Oct 23 15:56:11 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:56:11 user nova-compute[74421]:   <serial>5590649c-d4db-4738-a460-2c3ef8ed4621</serial>
Oct 23 15:56:11 user nova-compute[74421]: </disk>
Oct 23 15:56:11 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] No VIF found with MAC fa:16:3e:0e:e1:77, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 15:56:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9b992a23-d54e-49a6-be9e-e3807ffc1e24 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.423s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:13 user nova-compute[74421]: INFO nova.compute.manager [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Detaching volume 6150565c-6ef1-47a3-9526-1bbc5b01f3a0
Oct 23 15:56:13 user nova-compute[74421]: INFO nova.virt.block_device [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attempting to driver detach volume 6150565c-6ef1-47a3-9526-1bbc5b01f3a0 from mountpoint /dev/vdb
Oct 23 15:56:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Attempting to detach device vdb from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:56:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:56:13 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:56:13 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:56:13 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:56:13 user nova-compute[74421]:   <serial>6150565c-6ef1-47a3-9526-1bbc5b01f3a0</serial>
Oct 23 15:56:13 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:56:13 user nova-compute[74421]: </disk>
Oct 23 15:56:13 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:56:13 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully detached device vdb from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the persistent domain config.
Oct 23 15:56:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:56:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:56:13 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:56:13 user nova-compute[74421]:   <source dev="/dev/sdd"/>
Oct 23 15:56:13 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 15:56:13 user nova-compute[74421]:   <serial>6150565c-6ef1-47a3-9526-1bbc5b01f3a0</serial>
Oct 23 15:56:13 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 15:56:13 user nova-compute[74421]: </disk>
Oct 23 15:56:13 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:56:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:13 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:56:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:16 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:56:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:56:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:56:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:56:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:56:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:56:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:25 user nova-compute[74421]: INFO nova.compute.manager [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Terminating instance
Oct 23 15:56:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-e9b62884-fcb4-400e-a06c-9f2abd083159 req-e4d07e0c-d168-4c3a-ad81-4a1687a73c69 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-unplugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e9b62884-fcb4-400e-a06c-9f2abd083159 req-e4d07e0c-d168-4c3a-ad81-4a1687a73c69 service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e9b62884-fcb4-400e-a06c-9f2abd083159 req-e4d07e0c-d168-4c3a-ad81-4a1687a73c69 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e9b62884-fcb4-400e-a06c-9f2abd083159 req-e4d07e0c-d168-4c3a-ad81-4a1687a73c69 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-e9b62884-fcb4-400e-a06c-9f2abd083159 req-e4d07e0c-d168-4c3a-ad81-4a1687a73c69 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-unplugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.compute.manager [req-e9b62884-fcb4-400e-a06c-9f2abd083159 req-e4d07e0c-d168-4c3a-ad81-4a1687a73c69 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-unplugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Instance destroyed successfully.
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.objects.instance [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lazy-loading 'resources' on Instance uuid d31bcfcf-56bd-45b3-b01a-13371fb36cb2 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-159858116',display_name='tempest-TestMinimumBasicScenario-server-159858116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-159858116',id=44,image_ref='15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsrZTtz4R7MCRsI11bcpCPChR0Xd1CPEpd14vWmj3XcsVnTzZOik+RfWxiN+lJRE2xGjxekPGg11G063U+yUfd/+Bmd7iGjj9Z0CvKbtPmtrJe2Dz+oAWdPYHe9v3IOCw==',key_name='tempest-TestMinimumBasicScenario-1504781756',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:51:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c0fda43d4b42a16478be0d47270b',ramdisk_id='',reservation_id='r-5ptg9zh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='15da6d0d-8104-4c67-b4fd-5c5f7bd70b1d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824567034',owner_user_name='tempest-TestMinimumBasicScenario-1824567034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:53:41Z,user_data=None,user_id='ae006290eb4d49609eee46250660adb8',uuid=d31bcfcf-56bd-45b3-b01a-13371fb36cb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converting VIF {"id": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "address": "fa:16:3e:02:4d:03", "network": {"id": "a140279e-d277-46b2-9abb-978c9066ca45", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1539621477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c0fda43d4b42a16478be0d47270b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1c3a8d-94", "ovs_interfaceid": "eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG os_vif [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb1c3a8d-94, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81267630-9dd5-473c-a82d-f58d70fa6a2d) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:26 user nova-compute[74421]: INFO os_vif [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296,network=Network(a140279e-d277-46b2-9abb-978c9066ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1c3a8d-94')
Oct 23 15:56:26 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Deleting instance files /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2_del
Oct 23 15:56:26 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Deletion of /opt/stack/data/nova/instances/d31bcfcf-56bd-45b3-b01a-13371fb36cb2_del complete
Oct 23 15:56:26 user nova-compute[74421]: INFO nova.compute.manager [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 15:56:26 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:56:26 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:56:27 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:56:27 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Took 0.42 seconds to deallocate network for instance.
Oct 23 15:56:27 user nova-compute[74421]: DEBUG nova.compute.manager [req-8f40e929-8778-41b1-90cc-83a067f3f008 req-8a026d73-01ab-4a20-8800-6a1089e75b4d service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-deleted-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:27 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:56:27 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:56:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:27 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Deleted allocations for instance d31bcfcf-56bd-45b3-b01a-13371fb36cb2
Oct 23 15:56:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-4b8fa61c-8405-495c-934d-f48899d51265 tempest-TestMinimumBasicScenario-1824567034 tempest-TestMinimumBasicScenario-1824567034-project-member] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.678s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-31747482-7ca3-4081-be99-7960d2f5920c req-51d00baf-3295-4bdd-86ec-9712155ee596 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31747482-7ca3-4081-be99-7960d2f5920c req-51d00baf-3295-4bdd-86ec-9712155ee596 service nova] Acquiring lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31747482-7ca3-4081-be99-7960d2f5920c req-51d00baf-3295-4bdd-86ec-9712155ee596 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-31747482-7ca3-4081-be99-7960d2f5920c req-51d00baf-3295-4bdd-86ec-9712155ee596 service nova] Lock "d31bcfcf-56bd-45b3-b01a-13371fb36cb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:28 user nova-compute[74421]: DEBUG nova.compute.manager [req-31747482-7ca3-4081-be99-7960d2f5920c req-51d00baf-3295-4bdd-86ec-9712155ee596 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] No waiting events found dispatching network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:28 user nova-compute[74421]: WARNING nova.compute.manager [req-31747482-7ca3-4081-be99-7960d2f5920c req-51d00baf-3295-4bdd-86ec-9712155ee596 service nova] [instance: d31bcfcf-56bd-45b3-b01a-13371fb36cb2] Received unexpected event network-vif-plugged-eb1c3a8d-9433-4a8e-89b5-0e8ced1bb296 for instance with vm_state deleted and task_state None.
Oct 23 15:56:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:33 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 is timed out.
Oct 23 15:56:33 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully detached device vdb from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the live domain config.
Oct 23 15:56:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKBLvels', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:56:34 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a471fb7-1136-49a7-86cd-2ac5afa63d0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:56:34 user nova-compute[74421]: No targets found.
Oct 23 15:56:34 user nova-compute[74421]: iSNS:
Oct 23 15:56:34 user nova-compute[74421]: No targets found.
Oct 23 15:56:34 user nova-compute[74421]: STATIC:
Oct 23 15:56:34 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0
Oct 23 15:56:34 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:34 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:34 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55
Oct 23 15:56:34 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:34 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:34 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb
Oct 23 15:56:34 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:34 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:34 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621
Oct 23 15:56:34 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:34 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:34 user nova-compute[74421]: FIRMWARE:
Oct 23 15:56:34 user nova-compute[74421]: No targets found.
Oct 23 15:56:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:56:34 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:56:34 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6456574a-e3e1-4c2d-9d13-49a836b8b5dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9885fd8-4c89-4f34-bf57-40814eb5f773]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:34 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:34 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:34 user nova-compute[74421]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)
Oct 23 15:56:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:34 user nova-compute[74421]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 (non-flash)
Oct 23 15:56:34 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:34 user nova-compute[74421]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)
Oct 23 15:56:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247823b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0'): ({'sdd'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Removing single pathed devices sdd {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ec1812-e94f-462a-b7d9-5d04d23613e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd367fa-0a08-4e74-b216-0ddf42d94c1c]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Flushing IO for device /dev/sdd {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0070dc-22d2-4a0a-bd16-c5c7a5a585d1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8838762-75fd-45f4-b315-ee1506cd5912]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] SCSI volumes sdd have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.103s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91705e8-45db-48a7-8752-37448b940ca2]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f0966d-fb8f-434d-bfeb-9d133cc22848]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260]
Oct 23 15:56:34 user nova-compute[74421]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0, portal: 172.16.0.220,3260] successful.
Oct 23 15:56:34 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6150565c-6ef1-47a3-9526-1bbc5b01f3a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb522b1b-cbe7-443b-aa31-79b33b3408d8]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== disconnect_volume: return (392ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:56:34 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:56:35 user nova-compute[74421]: DEBUG nova.objects.instance [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-6c75d69e-0386-4d70-a49d-81613006e70a tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:36 user nova-compute[74421]: INFO nova.compute.manager [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Detaching volume 5590649c-d4db-4738-a460-2c3ef8ed4621
Oct 23 15:56:36 user nova-compute[74421]: INFO nova.virt.block_device [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Attempting to driver detach volume 5590649c-d4db-4738-a460-2c3ef8ed4621 from mountpoint /dev/vdc
Oct 23 15:56:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Attempting to detach device vdc from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:56:36 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:56:36 user nova-compute[74421]:   <source dev="/dev/sde"/>
Oct 23 15:56:36 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:56:36 user nova-compute[74421]:   <serial>5590649c-d4db-4738-a460-2c3ef8ed4621</serial>
Oct 23 15:56:36 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 15:56:36 user nova-compute[74421]: </disk>
Oct 23 15:56:36 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:56:36 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully detached device vdc from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the persistent domain config.
Oct 23 15:56:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 15:56:36 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 15:56:36 user nova-compute[74421]:   <source dev="/dev/sde"/>
Oct 23 15:56:36 user nova-compute[74421]:   <target dev="vdc" bus="virtio"/>
Oct 23 15:56:36 user nova-compute[74421]:   <serial>5590649c-d4db-4738-a460-2c3ef8ed4621</serial>
Oct 23 15:56:36 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 15:56:36 user nova-compute[74421]: </disk>
Oct 23 15:56:36 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 15:56:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:56 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 is timed out.
Oct 23 15:56:56 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully detached device vdc from instance bf08160e-b7c2-41d8-ae07-b645570dcfb8 from the live domain config.
Oct 23 15:56:56 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpvEUOHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:56:56 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c4f9c7-44e2-4fbb-a3f6-dd07eb25d4b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:56:56 user nova-compute[74421]: No targets found.
Oct 23 15:56:56 user nova-compute[74421]: iSNS:
Oct 23 15:56:56 user nova-compute[74421]: No targets found.
Oct 23 15:56:56 user nova-compute[74421]: STATIC:
Oct 23 15:56:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55
Oct 23 15:56:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb
Oct 23 15:56:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:56 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621
Oct 23 15:56:56 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:56:56 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:56:56 user nova-compute[74421]: FIRMWARE:
Oct 23 15:56:56 user nova-compute[74421]: No targets found.
Oct 23 15:56:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:56:56 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:56:56 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d716fd96-c2f2-413b-ab4b-1d118ca14b52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3608a16-1b78-49c5-a529-7bcb16f597e2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:56 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:56 user nova-compute[74421]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)
Oct 23 15:56:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:56:56 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:56:56 user nova-compute[74421]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 (non-flash)
Oct 23 15:56:56 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247857e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621'): ({'sde'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Removing single pathed devices sde {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cac5d8f-14b2-4875-b7b7-681d4b2df57d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[720a90ab-8acb-4c67-8df1-66d214136ab8]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Flushing IO for device /dev/sde {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[380fd045-da95-4abf-ac2d-5be8f28d808a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:56:56 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4799d-c55f-401e-a0e9-11b8632a7ea0]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] SCSI volumes sde have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da5fb14-661a-4bc7-aa7b-69eef4a29a79]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af89021-a076-4831-9062-782243926534]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260]
Oct 23 15:56:57 user nova-compute[74421]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621, portal: 172.16.0.220,3260] successful.
Oct 23 15:56:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5590649c-d4db-4738-a460-2c3ef8ed4621 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68ae48f-fe59-465b-82a0-07f39dffdde3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] <== disconnect_volume: return (295ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:56:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:56:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'flavor' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-2e34c719-dd09-4748-829f-f64ff735cb29 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.902s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:59 user nova-compute[74421]: INFO nova.compute.manager [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Terminating instance
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.compute.manager [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd2ec7ac-52f8-4227-93ce-df56d4064a0f req-c3da5ebd-2caa-49c6-9b97-f5f11e9498c2 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-vif-unplugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd2ec7ac-52f8-4227-93ce-df56d4064a0f req-c3da5ebd-2caa-49c6-9b97-f5f11e9498c2 service nova] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd2ec7ac-52f8-4227-93ce-df56d4064a0f req-c3da5ebd-2caa-49c6-9b97-f5f11e9498c2 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd2ec7ac-52f8-4227-93ce-df56d4064a0f req-c3da5ebd-2caa-49c6-9b97-f5f11e9498c2 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd2ec7ac-52f8-4227-93ce-df56d4064a0f req-c3da5ebd-2caa-49c6-9b97-f5f11e9498c2 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] No waiting events found dispatching network-vif-unplugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd2ec7ac-52f8-4227-93ce-df56d4064a0f req-c3da5ebd-2caa-49c6-9b97-f5f11e9498c2 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-vif-unplugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:56:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Instance destroyed successfully.
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.objects.instance [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lazy-loading 'resources' on Instance uuid bf08160e-b7c2-41d8-ae07-b645570dcfb8 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2022515064',display_name='tempest-AttachVolumeTestJSON-server-2022515064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2022515064',id=46,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLepw68i0DaOm8RHyRP5go+/x9TxWInGau3GfA2xAjO1pcfoIRfDKfmPPyhm+PwEr8kuGgpYGd/Lv72m10Wta2kLyy/PErEOejMV+rAVwMLl88zrugCLIdaAjC9jZI9B2A==',key_name='tempest-keypair-686852889',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c934c4c4f0304483809e410717e63030',ramdisk_id='',reservation_id='r-plgzxsqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-532911348',owner_user_name='tempest-AttachVolumeTestJSON-532911348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9af9227b4e74b97a2ee0b2aca32e74e',uuid=bf08160e-b7c2-41d8-ae07-b645570dcfb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converting VIF {"id": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "address": "fa:16:3e:0e:e1:77", "network": {"id": "a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-384645123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c934c4c4f0304483809e410717e63030", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b1d15-62", "ovs_interfaceid": "165b1d15-62cb-42df-a1ec-6f822b4fd6d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG os_vif [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap165b1d15-62, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b58929e-dd82-41ae-b6a2-840486eefa5a) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:56:59 user nova-compute[74421]: INFO os_vif [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:e1:77,bridge_name='br-int',has_traffic_filtering=True,id=165b1d15-62cb-42df-a1ec-6f822b4fd6d9,network=Network(a3d43e04-0aac-40fc-83b5-c7c6dda0cdf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b1d15-62')
Oct 23 15:56:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Deleting instance files /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8_del
Oct 23 15:56:59 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Deletion of /opt/stack/data/nova/instances/bf08160e-b7c2-41d8-ae07-b645570dcfb8_del complete
Oct 23 15:56:59 user nova-compute[74421]: INFO nova.compute.manager [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 23 15:56:59 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:56:59 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:57:00 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:57:00 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Took 1.01 seconds to deallocate network for instance.
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:01 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Deleted allocations for instance bf08160e-b7c2-41d8-ae07-b645570dcfb8
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fd192c17-42eb-46e1-96de-2e34bc42cbf3 tempest-AttachVolumeTestJSON-532911348 tempest-AttachVolumeTestJSON-532911348-project-member] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] Acquiring lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] Lock "bf08160e-b7c2-41d8-ae07-b645570dcfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] No waiting events found dispatching network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:57:01 user nova-compute[74421]: WARNING nova.compute.manager [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received unexpected event network-vif-plugged-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 for instance with vm_state deleted and task_state None.
Oct 23 15:57:01 user nova-compute[74421]: DEBUG nova.compute.manager [req-3373103d-caee-4868-97f2-744aec9407a5 req-5f08227a-f52d-49cc-862e-d575c090bb60 service nova] [instance: bf08160e-b7c2-41d8-ae07-b645570dcfb8] Received event network-vif-deleted-165b1d15-62cb-42df-a1ec-6f822b4fd6d9 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:57:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:04 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:05 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:05 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating instance_info_cache with network_info: [{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:57:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:07 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:57:07 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=24.960803985595703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:57:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:57:18 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:18 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Verify base images {{(pid=74421) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Image id 7e1fa5b4-fbd6-455e-aff9-730f266d34e3 yields fingerprint 1bedd919593b79ad5f4b641851296dcd25fd220e {{(pid=74421) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74421) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 is a valid instance name {{(pid=74421) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85 is a valid instance name {{(pid=74421) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716
Oct 23 15:57:28 user nova-compute[74421]: WARNING nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Removable base files: /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8 /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064 /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7 /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522 /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716 /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a94bf28d560ab3ff237c0740c8ba7b9c5f86ade8
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1bd5405b5120a68592029f8b2247097ed8c4660a
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/280e3e3ee4f2f24dfc35f24016066c8d69711064
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ea74bb1c537ec6321bd876b8b3f9d219e83012e
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3eba8b2739a15951719db7fdb3818ee991d50b7
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59c864ce83212e842c7774236dd3b27ee150a5de
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/07ae1568e318fd66732703c45ff2f0368c367522
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d8e4278b2ae402fb7a81a2464ccbd14fcd75716
Oct 23 15:57:28 user nova-compute[74421]: INFO nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3a51260008896d43b79cb2a99b61a99c5df5122c
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Verification complete {{(pid=74421) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Verify swap images {{(pid=74421) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 23 15:57:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.imagecache [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Verify ephemeral images {{(pid=74421) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 23 15:57:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:57:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-changed-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:57:30 user nova-compute[74421]: DEBUG nova.compute.manager [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Refreshing instance network info cache due to event network-changed-8a93b03f-540a-431b-b6e6-0c1d1a7db31f. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:57:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] Acquiring lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:57:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] Acquired lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:57:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Refreshing network info cache for port 8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:31 user nova-compute[74421]: INFO nova.compute.manager [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Terminating instance
Oct 23 15:57:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updated VIF entry in instance network info cache for port 8a93b03f-540a-431b-b6e6-0c1d1a7db31f. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG nova.network.neutron [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updating instance_info_cache with network_info: [{"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-b353a28b-c3b6-49fe-8283-5d9375529e1d req-6427960d-3590-4a41-a01a-5e955bf328e6 service nova] Releasing lock "refresh_cache-1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ffacd8b-ce6e-4f09-a759-133f049ac874 req-11ba49d3-a3a9-456b-90aa-60d1267444a5 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-vif-unplugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ffacd8b-ce6e-4f09-a759-133f049ac874 req-11ba49d3-a3a9-456b-90aa-60d1267444a5 service nova] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ffacd8b-ce6e-4f09-a759-133f049ac874 req-11ba49d3-a3a9-456b-90aa-60d1267444a5 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-1ffacd8b-ce6e-4f09-a759-133f049ac874 req-11ba49d3-a3a9-456b-90aa-60d1267444a5 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ffacd8b-ce6e-4f09-a759-133f049ac874 req-11ba49d3-a3a9-456b-90aa-60d1267444a5 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] No waiting events found dispatching network-vif-unplugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:57:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-1ffacd8b-ce6e-4f09-a759-133f049ac874 req-11ba49d3-a3a9-456b-90aa-60d1267444a5 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-vif-unplugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:57:32 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Instance destroyed successfully.
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.objects.instance [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lazy-loading 'resources' on Instance uuid 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-709444670',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-709444670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-709444670',id=48,image_ref='7e1fa5b4-fbd6-455e-aff9-730f266d34e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjjJ0AgiPWJjNcXyrSjy/1JPLbrXbfzX2B1UjzsuupkVrE85ph8XX3VjZ3ZTKk7T61Qb9BqQe51QXJzFj4SN0Y/QcICklF1k/zNyyzqseCzo3LOTPy29jbhCMDltzA3wA==',key_name='tempest-keypair-1955277539',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-0wk0wuv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1940666020',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "address": "fa:16:3e:56:0c:6f", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a93b03f-54", "ovs_interfaceid": "8a93b03f-540a-431b-b6e6-0c1d1a7db31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_vif [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a93b03f-54, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2498656-7388-42af-b27c-6e56b46d495c) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:32 user nova-compute[74421]: INFO os_vif [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=8a93b03f-540a-431b-b6e6-0c1d1a7db31f,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a93b03f-54')
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUmwVGzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:57:32 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5bd328-9147-4629-8070-60288b5a3f7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:57:32 user nova-compute[74421]: No targets found.
Oct 23 15:57:32 user nova-compute[74421]: iSNS:
Oct 23 15:57:32 user nova-compute[74421]: No targets found.
Oct 23 15:57:32 user nova-compute[74421]: STATIC:
Oct 23 15:57:32 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55
Oct 23 15:57:32 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:57:32 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:57:32 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb
Oct 23 15:57:32 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:57:32 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:57:32 user nova-compute[74421]: FIRMWARE:
Oct 23 15:57:32 user nova-compute[74421]: No targets found.
Oct 23 15:57:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:57:32 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:57:32 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045e306-f382-4684-b685-4746fdd96716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55afba7-7459-44ee-acb0-900a5cff22bb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:57:32 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:57:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:57:32 user nova-compute[74421]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb (non-flash)
Oct 23 15:57:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24801bf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[555c659c-478f-4276-aaad-bdcb6de06578]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d1d62-61c7-44bd-b5d3-d1f77ea02c21]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[01038834-4667-400d-b747-8d7b25a3b9a6]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2d3ac3-ad57-49df-9906-0b23af2861a7]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO18d1d796-bf37c7280830ebdc', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_18d1d796', '/dev/disk/by-id/scsi-26266333763373238') {{(pid=85617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9503674f-5505-40e1-84d0-06e409b34b43]: (4, None) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b8f06a-dd08-49d7-8845-652d50560cf8]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a1ddcc-d059-4254-bb41-258eb1646bca]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260]
Oct 23 15:57:32 user nova-compute[74421]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb, portal: 172.16.0.220,3260] successful.
Oct 23 15:57:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c6282e-0c19-49b3-a0db-ef70c1f4ba78]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== disconnect_volume: return (336ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:57:32 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Deleting instance files /opt/stack/data/nova/instances/1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85_del
Oct 23 15:57:32 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Deletion of /opt/stack/data/nova/instances/1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85_del complete
Oct 23 15:57:32 user nova-compute[74421]: INFO nova.compute.manager [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 23 15:57:32 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:57:32 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:57:33 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:57:33 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Took 1.12 seconds to deallocate network for instance.
Oct 23 15:57:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:57:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] Acquiring lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] No waiting events found dispatching network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:57:34 user nova-compute[74421]: WARNING nova.compute.manager [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received unexpected event network-vif-plugged-8a93b03f-540a-431b-b6e6-0c1d1a7db31f for instance with vm_state active and task_state deleting.
Oct 23 15:57:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-bc83a98d-14ad-4009-85fb-0b0a187dbbc7 req-09381078-aaa8-4cc1-b0da-15c4dde3f6f3 service nova] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Received event network-vif-deleted-8a93b03f-540a-431b-b6e6-0c1d1a7db31f {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:57:35 user nova-compute[74421]: INFO nova.compute.manager [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Took 1.91 seconds to detach 1 volumes for instance.
Oct 23 15:57:35 user nova-compute[74421]: DEBUG nova.compute.manager [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85] Deleting volume: 887fc2ce-4046-4f42-a75b-cbc4b0a5d8bb {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 15:57:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:57:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:57:35 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:57:35 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:57:35 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:35 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Deleted allocations for instance 1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85
Oct 23 15:57:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-58809a5a-79fd-4f38-9d98-66c23eaac472 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "1d3c518c-d81d-4ce6-8e6e-bc4043dd6a85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.538s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:57:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:57:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:58:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 15:58:06 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating instance_info_cache with network_info: [{"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 15:58:07 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:58:07 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:58:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=24.990039825439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:08 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 15:58:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 15:58:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 15:58:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:31 user nova-compute[74421]: INFO nova.compute.manager [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Terminating instance
Oct 23 15:58:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-d5f7911a-abdf-4854-a40f-9d65a8244250 req-3b81ad4c-952e-4bdf-92a5-ae4d2e780e10 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-vif-unplugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d5f7911a-abdf-4854-a40f-9d65a8244250 req-3b81ad4c-952e-4bdf-92a5-ae4d2e780e10 service nova] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d5f7911a-abdf-4854-a40f-9d65a8244250 req-3b81ad4c-952e-4bdf-92a5-ae4d2e780e10 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-d5f7911a-abdf-4854-a40f-9d65a8244250 req-3b81ad4c-952e-4bdf-92a5-ae4d2e780e10 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-d5f7911a-abdf-4854-a40f-9d65a8244250 req-3b81ad4c-952e-4bdf-92a5-ae4d2e780e10 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] No waiting events found dispatching network-vif-unplugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:58:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-d5f7911a-abdf-4854-a40f-9d65a8244250 req-3b81ad4c-952e-4bdf-92a5-ae4d2e780e10 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-vif-unplugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Instance destroyed successfully.
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.objects.instance [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lazy-loading 'resources' on Instance uuid ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1034682774',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1034682774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1034682774',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVH4BrZr+qVQ2m9dMZcbvsfiXv6vySseLevT8duvwvr4LgyaIfXYXYCJpH3Pa4PB76xHjQlv9XzKrc0s3xOjfHUr12qUOqNnzURG/q1/Z8XeX65Vy6XZOzm6+uhiogXAw==',key_name='tempest-keypair-1339892157',keypairs=<?>,launch_index=0,launched_at=2023-10-23T15:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-8e1xv6ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T15:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "address": "fa:16:3e:5c:d1:e8", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6542a61b-d6", "ovs_interfaceid": "6542a61b-d6ce-49b6-9a97-d0526fc571bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_vif [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6542a61b-d6, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b1fce4b-65ff-4d8f-80e2-0cc48b55df9e) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:32 user nova-compute[74421]: INFO os_vif [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:d1:e8,bridge_name='br-int',has_traffic_filtering=True,id=6542a61b-d6ce-49b6-9a97-d0526fc571bb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6542a61b-d6')
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTwZBlmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:58:32 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeea4b1d-0ea2-44b5-a628-ffa943d9438a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 15:58:32 user nova-compute[74421]: No targets found.
Oct 23 15:58:32 user nova-compute[74421]: iSNS:
Oct 23 15:58:32 user nova-compute[74421]: No targets found.
Oct 23 15:58:32 user nova-compute[74421]: STATIC:
Oct 23 15:58:32 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55
Oct 23 15:58:32 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 15:58:32 user nova-compute[74421]:                 Iface Name: default
Oct 23 15:58:32 user nova-compute[74421]: FIRMWARE:
Oct 23 15:58:32 user nova-compute[74421]: No targets found.
Oct 23 15:58:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 15:58:32 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 15:58:32 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9bdbe4-46f5-490a-b1b9-06a377c1d9ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121e422-f3aa-467f-83f0-b8f3e23643af]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:58:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 (non-flash)
Oct 23 15:58:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247823bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55'): ({'sdc'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Removing single pathed devices sdc {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d49fec-96cb-490d-a0cb-385b02261b7c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723ee61-7d06-4641-bff7-189fd20bd2a3]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Flushing IO for device /dev/sdc {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf25318-7206-438f-9fa5-69539e6aa907]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0483255-1ad7-4858-83e0-1d9e836fe9c3]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] SCSI volumes sdc have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d917dd49', '/dev/disk/by-id/scsi-1SCST_BIOd917dd49-ab4573f00222ef0d', '/dev/disk/by-id/scsi-26162343537336630') {{(pid=85617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a338ad-8735-4267-865b-a439576efb0a]: (4, None) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73ebee-8a13-48a6-b157-f0fcb32858e4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f12e6-d818-4df7-9e9b-83c7ef57cad0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260]
Oct 23 15:58:32 user nova-compute[74421]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55, portal: 172.16.0.220,3260] successful.
Oct 23 15:58:32 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0ee81f-8bff-40c0-95f1-9dcca0496a55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd127d34-ee28-44a3-ae8e-02822052f47b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== disconnect_volume: return (292ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 15:58:32 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Deleting instance files /opt/stack/data/nova/instances/ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13_del
Oct 23 15:58:32 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Deletion of /opt/stack/data/nova/instances/ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13_del complete
Oct 23 15:58:32 user nova-compute[74421]: INFO nova.compute.manager [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 23 15:58:32 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:58:32 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:58:33 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:58:33 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Took 0.85 seconds to deallocate network for instance.
Oct 23 15:58:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-c01b3050-d56b-49f2-8cfb-233d2a8d5150 req-19236f5e-ed82-45fd-aa35-15baed5ab6d8 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-vif-deleted-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-efc01414-1209-4ce2-91a2-bc205c00c849 req-dcd63899-c98d-43a9-b87e-afed04dc2c86 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received event network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-efc01414-1209-4ce2-91a2-bc205c00c849 req-dcd63899-c98d-43a9-b87e-afed04dc2c86 service nova] Acquiring lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-efc01414-1209-4ce2-91a2-bc205c00c849 req-dcd63899-c98d-43a9-b87e-afed04dc2c86 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-efc01414-1209-4ce2-91a2-bc205c00c849 req-dcd63899-c98d-43a9-b87e-afed04dc2c86 service nova] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG nova.compute.manager [req-efc01414-1209-4ce2-91a2-bc205c00c849 req-dcd63899-c98d-43a9-b87e-afed04dc2c86 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] No waiting events found dispatching network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 15:58:34 user nova-compute[74421]: WARNING nova.compute.manager [req-efc01414-1209-4ce2-91a2-bc205c00c849 req-dcd63899-c98d-43a9-b87e-afed04dc2c86 service nova] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Received unexpected event network-vif-plugged-6542a61b-d6ce-49b6-9a97-d0526fc571bb for instance with vm_state active and task_state deleting.
Oct 23 15:58:34 user nova-compute[74421]: INFO nova.compute.manager [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Took 0.80 seconds to detach 1 volumes for instance.
Oct 23 15:58:34 user nova-compute[74421]: DEBUG nova.compute.manager [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13] Deleting volume: ca0ee81f-8bff-40c0-95f1-9dcca0496a55 {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:34 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Deleted allocations for instance ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13
Oct 23 15:58:34 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-5dc61192-4203-482b-a623-68c602c1d6b6 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "ef3ee5fc-4330-4ff7-a85a-8eeb91e72b13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.220s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:58:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:51 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:58:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:58:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 15:59:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 15:59:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 15:59:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:59:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:59:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:59:07 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 15:59:08 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:59:08 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 15:59:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9052MB free_disk=24.98687744140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 15:59:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:59:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:16 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:20 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 15:59:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 15:59:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:23 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "e4947b1f-9812-4587-945c-e40c138ecb3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:59:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "e4947b1f-9812-4587-945c-e40c138ecb3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:59:41 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 15:59:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:59:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:59:41 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 15:59:41 user nova-compute[74421]: INFO nova.compute.claims [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Claim successful on node user
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 15:59:42 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 15:59:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 15:59:42 user nova-compute[74421]: INFO nova.virt.block_device [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Booting with volume 33b88a37-5c08-490f-8002-03130d528c30 at /dev/vda
Oct 23 15:59:42 user nova-compute[74421]: DEBUG os_brick.utils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7662a469-4baa-4fa0-8cc6-2602c2dfcadb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d7b16-39fb-4b06-bc42-d6ebdaa3d61c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6310c355-32b8-48fa-a253-351a9840e09d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d6ce86-e9a1-4704-afcb-ff6df7bd56bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 15:59:42 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 15:59:42 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aa662d-7d97-4ae5-ae98-69f4226a49a9]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG os_brick.utils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Updating existing volume attachment record: f7b468d4-65ef-4ba7-9cf3-7ca7bfd1ca93 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 15:59:42 user nova-compute[74421]: DEBUG nova.policy [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8decd53c14b49fe8ab2765e7f0c726d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beee00c4721f4f89942da65f6571c1d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 15:59:43 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Successfully created port: 97a9b5f8-f909-4802-9497-f93cd5b608eb {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Successfully updated port: 97a9b5f8-f909-4802-9497-f93cd5b608eb {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "refresh_cache-e4947b1f-9812-4587-945c-e40c138ecb3a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquired lock "refresh_cache-e4947b1f-9812-4587-945c-e40c138ecb3a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Received event network-changed-97a9b5f8-f909-4802-9497-f93cd5b608eb {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.compute.manager [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Refreshing instance network info cache due to event network-changed-97a9b5f8-f909-4802-9497-f93cd5b608eb. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] Acquiring lock "refresh_cache-e4947b1f-9812-4587-945c-e40c138ecb3a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Updating instance_info_cache with network_info: [{"id": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "address": "fa:16:3e:c5:ae:ad", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a9b5f8-f9", "ovs_interfaceid": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Releasing lock "refresh_cache-e4947b1f-9812-4587-945c-e40c138ecb3a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Instance network_info: |[{"id": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "address": "fa:16:3e:c5:ae:ad", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a9b5f8-f9", "ovs_interfaceid": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] Acquired lock "refresh_cache-e4947b1f-9812-4587-945c-e40c138ecb3a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 15:59:44 user nova-compute[74421]: DEBUG nova.network.neutron [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Refreshing network info cache for port 97a9b5f8-f909-4802-9497-f93cd5b608eb {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 15:59:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Updated VIF entry in instance network info cache for port 97a9b5f8-f909-4802-9497-f93cd5b608eb. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 15:59:45 user nova-compute[74421]: DEBUG nova.network.neutron [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Updating instance_info_cache with network_info: [{"id": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "address": "fa:16:3e:c5:ae:ad", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a9b5f8-f9", "ovs_interfaceid": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:59:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-4e3ba96d-de18-4ed9-afe4-f768d207589d req-65533744-cecc-4f93-89ea-e88493acdfba service nova] Releasing lock "refresh_cache-e4947b1f-9812-4587-945c-e40c138ecb3a" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 15:59:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 15:59:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 15:59:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:59:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 15:59:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.volume.cinder [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Update attachment failed for attachment f7b468d4-65ef-4ba7-9cf3-7ca7bfd1ca93. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Traceback (most recent call last):
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     driver_block_device.attach_block_devices(
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     _log_and_attach(device)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     bdm.attach(*attach_args, **attach_kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     ret_val = method(obj, context, *args, **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     self._do_attach(context, instance, volume, volume_api,
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     self._volume_attach(context, volume, connector, instance,
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     connection_info = volume_api.attachment_update(
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     res = method(self, ctx, *args, **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     with excutils.save_and_reraise_exception():
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     self.force_reraise()
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     raise self.value
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     return method.func(obj, *args, **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     resp = self._update('/attachments/%s' % id, body)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     return self.request(url, method, **kwargs)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a]     raise exceptions.from_response(resp, body)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9)
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] 
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.claims [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Aborting claim: <nova.compute.claims.Claim object at 0x7f248020fcd0> {{(pid=74421) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.255s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Build of instance e4947b1f-9812-4587-945c-e40c138ecb3a aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9) {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.utils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Build of instance e4947b1f-9812-4587-945c-e40c138ecb3a aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74421) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 23 15:59:57 user nova-compute[74421]: ERROR nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Build of instance e4947b1f-9812-4587-945c-e40c138ecb3a aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9): nova.exception.BuildAbortException: Build of instance e4947b1f-9812-4587-945c-e40c138ecb3a aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-24f87ec3-f2fd-430c-a2fa-41ca351018b9)
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Unplugging VIFs for instance {{(pid=74421) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T15:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1133137194',display_name='tempest-TestVolumeBootPattern-server-1133137194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1133137194',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1FPBJ1wHY5JEs6F3ifbd0vkfHgri0kN671pnAn+glsbDPSJxyzr7/i17FNHLT/govPdCwbq1f5u7OsfTd19p+KUvOBycfoxAdS/D4Dc84HWzGROqadJQkjVlZCSuyH+g==',key_name='tempest-TestVolumeBootPattern-2011657615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beee00c4721f4f89942da65f6571c1d8',ramdisk_id='',reservation_id='r-3e0kuadw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1940666020',owner_user_name='tempest-TestVolumeBootPattern-1940666020-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T15:59:42Z,user_data=None,user_id='d8decd53c14b49fe8ab2765e7f0c726d',uuid=e4947b1f-9812-4587-945c-e40c138ecb3a,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "address": "fa:16:3e:c5:ae:ad", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a9b5f8-f9", "ovs_interfaceid": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converting VIF {"id": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "address": "fa:16:3e:c5:ae:ad", "network": {"id": "f5c83340-6cad-4d7e-b09b-cc9efee9e1cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1586147161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beee00c4721f4f89942da65f6571c1d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a9b5f8-f9", "ovs_interfaceid": "97a9b5f8-f909-4802-9497-f93cd5b608eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ae:ad,bridge_name='br-int',has_traffic_filtering=True,id=97a9b5f8-f909-4802-9497-f93cd5b608eb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a9b5f8-f9') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG os_vif [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ae:ad,bridge_name='br-int',has_traffic_filtering=True,id=97a9b5f8-f909-4802-9497-f93cd5b608eb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a9b5f8-f9') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97a9b5f8-f9, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 15:59:57 user nova-compute[74421]: INFO os_vif [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ae:ad,bridge_name='br-int',has_traffic_filtering=True,id=97a9b5f8-f909-4802-9497-f93cd5b608eb,network=Network(f5c83340-6cad-4d7e-b09b-cc9efee9e1cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a9b5f8-f9')
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Unplugged VIFs for instance {{(pid=74421) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 15:59:57 user nova-compute[74421]: DEBUG nova.network.neutron [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 15:59:57 user nova-compute[74421]: INFO nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Took 0.52 seconds to deallocate network for instance.
Oct 23 15:59:58 user nova-compute[74421]: DEBUG nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Detaching volume: 33b88a37-5c08-490f-8002-03130d528c30 {{(pid=74421) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 23 15:59:58 user nova-compute[74421]: INFO nova.compute.manager [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Detaching volume 33b88a37-5c08-490f-8002-03130d528c30
Oct 23 15:59:58 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] [instance: e4947b1f-9812-4587-945c-e40c138ecb3a] Skipping driver_detach during remote rebuild. {{(pid=74421) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 23 15:59:58 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Deleted allocations for instance e4947b1f-9812-4587-945c-e40c138ecb3a
Oct 23 15:59:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-c87d7aca-b14d-4766-80e1-74f827afdd30 tempest-TestVolumeBootPattern-1940666020 tempest-TestVolumeBootPattern-1940666020-project-member] Lock "e4947b1f-9812-4587-945c-e40c138ecb3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.624s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:00:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4956-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:00:06 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:00:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:00:06 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 16:00:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:00:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:00:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:00:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:00:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:00:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:00:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=24.975936889648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:00:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:00:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:21 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:00:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:00:24 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:00:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:32 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:37 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:00:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:00:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:00:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:00:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:00:42 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:47 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:00:48 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:52 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:00:57 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:01:07 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 16:01:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:01:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:01:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:01:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9130MB free_disk=24.973182678222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:01:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:12 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:01:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:16 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:17 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:18 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:22 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:23 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:23 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:01:23 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:01:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Starting instance... {{(pid=74421) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74421) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 16:01:27 user nova-compute[74421]: INFO nova.compute.claims [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Claim successful on node user
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Start building networks asynchronously for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Allocating IP information in the background. {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.network.neutron [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] allocate_for_instance() {{(pid=74421) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 16:01:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Start building block device mappings for instance. {{(pid=74421) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.policy [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f03fb67d444547f0a4690111647a9834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214fcda267154c66876db5ad7a4b540c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74421) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Start spawning the instance on the hypervisor. {{(pid=74421) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 16:01:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Creating instance directory {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 16:01:27 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Creating image(s)
Oct 23 16:01:27 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "/opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "/opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "/opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.178s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk 1073741824 {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee,backing_fmt=raw /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk 1073741824" returned: 0 in 0.092s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "426c3b57fd358c522e3c0ab8315cc40ddb5543ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/426c3b57fd358c522e3c0ab8315cc40ddb5543ee --force-share --output=json" returned: 0 in 0.172s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk. size=1073741824 {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG nova.network.neutron [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Successfully created port: 9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG nova.virt.disk.api [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Cannot resize image /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk to a smaller size. {{(pid=74421) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Created local disks {{(pid=74421) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Ensure instance console log exists: /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/console.log {{(pid=74421) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Successfully updated port: 9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Building network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-changed-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Refreshing instance network info cache due to event network-changed-9c07e2aa-f747-4b58-b113-2a7f6efa7f19. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Instance cache missing network info. {{(pid=74421) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.neutron [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Instance network_info: |[{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74421) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.neutron [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Refreshing network info cache for port 9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Start _get_guest_xml network_info=[{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8df87536-9d51-4582-bc16-f205abcf2ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 16:01:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:01:29 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CPU controller missing on host. {{(pid=74421) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.host [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CPU controller found on host. {{(pid=74421) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74421) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T15:17:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T15:17:57Z,direct_url=<?>,disk_format='qcow2',id=8df87536-9d51-4582-bc16-f205abcf2ad4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='df2b2b1c5c2a40d29cd895d80c0344e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T15:17:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Flavor limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Image limits 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Flavor pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Image pref 0:0:0 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Got 1 possible topologies {{(pid=74421) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.hardware [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74421) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T16:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-291319157',display_name='tempest-SnapshotDataIntegrityTests-server-291319157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-291319157',id=50,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYV3WVxhSEgGKF17DKEapDBQEYdveMe1Jztl9HSUuvPzlk2IqLtBAbncEf0piAff/bD8BRatkal/EyFnYSo4bExg4XZUYiPdMnLSLiyFzMzXdcaifuzdTxHPg+49tRPVw==',key_name='tempest-keypair-91072463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='214fcda267154c66876db5ad7a4b540c',ramdisk_id='',reservation_id='r-pha1mk16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1759465241',owner_user_name='tempest-SnapshotDataIntegrityTests-1759465241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T16:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f03fb67d444547f0a4690111647a9834',uuid=4703e926-b710-49c2-9fab-3d72cf4af402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74421) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Converting VIF {"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.objects.instance [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'pci_devices' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] End _get_guest_xml xml=<domain type="kvm">
Oct 23 16:01:29 user nova-compute[74421]:   <uuid>4703e926-b710-49c2-9fab-3d72cf4af402</uuid>
Oct 23 16:01:29 user nova-compute[74421]:   <name>instance-00000032</name>
Oct 23 16:01:29 user nova-compute[74421]:   <memory>524288</memory>
Oct 23 16:01:29 user nova-compute[74421]:   <vcpu>1</vcpu>
Oct 23 16:01:29 user nova-compute[74421]:   <metadata>
Oct 23 16:01:29 user nova-compute[74421]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 16:01:29 user nova-compute[74421]:       <nova:package version="0.0.0"/>
Oct 23 16:01:29 user nova-compute[74421]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-291319157</nova:name>
Oct 23 16:01:29 user nova-compute[74421]:       <nova:creationTime>2023-10-23 16:01:29</nova:creationTime>
Oct 23 16:01:29 user nova-compute[74421]:       <nova:flavor name="m1.tiny">
Oct 23 16:01:29 user nova-compute[74421]:         <nova:memory>512</nova:memory>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:disk>1</nova:disk>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:swap>0</nova:swap>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:vcpus>1</nova:vcpus>
Oct 23 16:01:29 user nova-compute[74421]:       </nova:flavor>
Oct 23 16:01:29 user nova-compute[74421]:       <nova:owner>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:user uuid="f03fb67d444547f0a4690111647a9834">tempest-SnapshotDataIntegrityTests-1759465241-project-member</nova:user>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:project uuid="214fcda267154c66876db5ad7a4b540c">tempest-SnapshotDataIntegrityTests-1759465241</nova:project>
Oct 23 16:01:29 user nova-compute[74421]:       </nova:owner>
Oct 23 16:01:29 user nova-compute[74421]:       <nova:root type="image" uuid="8df87536-9d51-4582-bc16-f205abcf2ad4"/>
Oct 23 16:01:29 user nova-compute[74421]:       <nova:ports>
Oct 23 16:01:29 user nova-compute[74421]:         <nova:port uuid="9c07e2aa-f747-4b58-b113-2a7f6efa7f19">
Oct 23 16:01:29 user nova-compute[74421]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 16:01:29 user nova-compute[74421]:         </nova:port>
Oct 23 16:01:29 user nova-compute[74421]:       </nova:ports>
Oct 23 16:01:29 user nova-compute[74421]:     </nova:instance>
Oct 23 16:01:29 user nova-compute[74421]:   </metadata>
Oct 23 16:01:29 user nova-compute[74421]:   <sysinfo type="smbios">
Oct 23 16:01:29 user nova-compute[74421]:     <system>
Oct 23 16:01:29 user nova-compute[74421]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 16:01:29 user nova-compute[74421]:       <entry name="product">OpenStack Nova</entry>
Oct 23 16:01:29 user nova-compute[74421]:       <entry name="version">0.0.0</entry>
Oct 23 16:01:29 user nova-compute[74421]:       <entry name="serial">4703e926-b710-49c2-9fab-3d72cf4af402</entry>
Oct 23 16:01:29 user nova-compute[74421]:       <entry name="uuid">4703e926-b710-49c2-9fab-3d72cf4af402</entry>
Oct 23 16:01:29 user nova-compute[74421]:       <entry name="family">Virtual Machine</entry>
Oct 23 16:01:29 user nova-compute[74421]:     </system>
Oct 23 16:01:29 user nova-compute[74421]:   </sysinfo>
Oct 23 16:01:29 user nova-compute[74421]:   <os>
Oct 23 16:01:29 user nova-compute[74421]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 16:01:29 user nova-compute[74421]:     <boot dev="hd"/>
Oct 23 16:01:29 user nova-compute[74421]:     <smbios mode="sysinfo"/>
Oct 23 16:01:29 user nova-compute[74421]:   </os>
Oct 23 16:01:29 user nova-compute[74421]:   <features>
Oct 23 16:01:29 user nova-compute[74421]:     <acpi/>
Oct 23 16:01:29 user nova-compute[74421]:     <apic/>
Oct 23 16:01:29 user nova-compute[74421]:     <vmcoreinfo/>
Oct 23 16:01:29 user nova-compute[74421]:   </features>
Oct 23 16:01:29 user nova-compute[74421]:   <clock offset="utc">
Oct 23 16:01:29 user nova-compute[74421]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 16:01:29 user nova-compute[74421]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 16:01:29 user nova-compute[74421]:     <timer name="hpet" present="no"/>
Oct 23 16:01:29 user nova-compute[74421]:   </clock>
Oct 23 16:01:29 user nova-compute[74421]:   <cpu mode="custom" match="exact">
Oct 23 16:01:29 user nova-compute[74421]:     <model>Nehalem</model>
Oct 23 16:01:29 user nova-compute[74421]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 16:01:29 user nova-compute[74421]:   </cpu>
Oct 23 16:01:29 user nova-compute[74421]:   <devices>
Oct 23 16:01:29 user nova-compute[74421]:     <disk type="file" device="disk">
Oct 23 16:01:29 user nova-compute[74421]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 16:01:29 user nova-compute[74421]:       <source file="/opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk"/>
Oct 23 16:01:29 user nova-compute[74421]:       <target dev="vda" bus="virtio"/>
Oct 23 16:01:29 user nova-compute[74421]:     </disk>
Oct 23 16:01:29 user nova-compute[74421]:     <interface type="ethernet">
Oct 23 16:01:29 user nova-compute[74421]:       <mac address="fa:16:3e:1a:bc:32"/>
Oct 23 16:01:29 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 16:01:29 user nova-compute[74421]:       <mtu size="1442"/>
Oct 23 16:01:29 user nova-compute[74421]:       <target dev="tap9c07e2aa-f7"/>
Oct 23 16:01:29 user nova-compute[74421]:     </interface>
Oct 23 16:01:29 user nova-compute[74421]:     <serial type="pty">
Oct 23 16:01:29 user nova-compute[74421]:       <log file="/opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/console.log" append="off"/>
Oct 23 16:01:29 user nova-compute[74421]:     </serial>
Oct 23 16:01:29 user nova-compute[74421]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 16:01:29 user nova-compute[74421]:     <video>
Oct 23 16:01:29 user nova-compute[74421]:       <model type="virtio"/>
Oct 23 16:01:29 user nova-compute[74421]:     </video>
Oct 23 16:01:29 user nova-compute[74421]:     <rng model="virtio">
Oct 23 16:01:29 user nova-compute[74421]:       <backend model="random">/dev/urandom</backend>
Oct 23 16:01:29 user nova-compute[74421]:     </rng>
Oct 23 16:01:29 user nova-compute[74421]:     <controller type="usb" index="0" model="none"/>
Oct 23 16:01:29 user nova-compute[74421]:     <memballoon model="virtio">
Oct 23 16:01:29 user nova-compute[74421]:       <stats period="10"/>
Oct 23 16:01:29 user nova-compute[74421]:     </memballoon>
Oct 23 16:01:29 user nova-compute[74421]:   </devices>
Oct 23 16:01:29 user nova-compute[74421]: </domain>
Oct 23 16:01:29 user nova-compute[74421]:  {{(pid=74421) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T16:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-291319157',display_name='tempest-SnapshotDataIntegrityTests-server-291319157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-291319157',id=50,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYV3WVxhSEgGKF17DKEapDBQEYdveMe1Jztl9HSUuvPzlk2IqLtBAbncEf0piAff/bD8BRatkal/EyFnYSo4bExg4XZUYiPdMnLSLiyFzMzXdcaifuzdTxHPg+49tRPVw==',key_name='tempest-keypair-91072463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='214fcda267154c66876db5ad7a4b540c',ramdisk_id='',reservation_id='r-pha1mk16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1759465241',owner_user_name='tempest-SnapshotDataIntegrityTests-1759465241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T16:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f03fb67d444547f0a4690111647a9834',uuid=4703e926-b710-49c2-9fab-3d72cf4af402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Converting VIF {"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG os_vif [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7') {{(pid=74421) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f395a35-07ac-5f66-8db7-8c6f81b4eecf', '_type': 'linux-noop'}}, row=False) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c07e2aa-f7, may_exist=True, interface_attrs={}) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c07e2aa-f7, col_values=(('qos', UUID('0649bd39-2b5a-4bc4-b27d-25dc46d715f1')),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c07e2aa-f7, col_values=(('external_ids', {'iface-id': '9c07e2aa-f747-4b58-b113-2a7f6efa7f19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:bc:32', 'vm-uuid': '4703e926-b710-49c2-9fab-3d72cf4af402'}),), if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:29 user nova-compute[74421]: INFO os_vif [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7')
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:01:29 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No VIF found with MAC fa:16:3e:1a:bc:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 16:01:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated VIF entry in instance network info cache for port 9c07e2aa-f747-4b58-b113-2a7f6efa7f19. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 16:01:30 user nova-compute[74421]: DEBUG nova.network.neutron [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:01:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd373aad-af72-42c0-ad34-7c315c2bc60a req-3e642f83-5737-4108-a22c-4655ef048635 service nova] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd454b3c-5804-4086-a1ba-bb88f450f102 req-e80f6155-44fb-4b03-a34f-83d020022ea4 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd454b3c-5804-4086-a1ba-bb88f450f102 req-e80f6155-44fb-4b03-a34f-83d020022ea4 service nova] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd454b3c-5804-4086-a1ba-bb88f450f102 req-e80f6155-44fb-4b03-a34f-83d020022ea4 service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-dd454b3c-5804-4086-a1ba-bb88f450f102 req-e80f6155-44fb-4b03-a34f-83d020022ea4 service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG nova.compute.manager [req-dd454b3c-5804-4086-a1ba-bb88f450f102 req-e80f6155-44fb-4b03-a34f-83d020022ea4 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] No waiting events found dispatching network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 16:01:31 user nova-compute[74421]: WARNING nova.compute.manager [req-dd454b3c-5804-4086-a1ba-bb88f450f102 req-e80f6155-44fb-4b03-a34f-83d020022ea4 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received unexpected event network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 for instance with vm_state building and task_state spawning.
Oct 23 16:01:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Instance event wait completed in 0 seconds for  {{(pid=74421) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Guest created on hypervisor {{(pid=74421) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 16:01:33 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Instance spawned successfully.
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Found default for hw_cdrom_bus of ide {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Found default for hw_disk_bus of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Found default for hw_input_bus of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Found default for hw_pointer_model of None {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Found default for hw_video_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Found default for hw_vif_model of virtio {{(pid=74421) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 16:01:33 user nova-compute[74421]: INFO nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Checking state {{(pid=74421) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 16:01:33 user nova-compute[74421]: INFO nova.compute.manager [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Took 6.03 seconds to build instance.
Oct 23 16:01:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-cb312a5f-98a4-407f-b0e5-89977291ae96 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.140s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-e10b12d1-b662-427e-989d-d1dca6c9d535 req-3be05720-94aa-412a-949c-270d6a13ab6f service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e10b12d1-b662-427e-989d-d1dca6c9d535 req-3be05720-94aa-412a-949c-270d6a13ab6f service nova] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e10b12d1-b662-427e-989d-d1dca6c9d535 req-3be05720-94aa-412a-949c-270d6a13ab6f service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-e10b12d1-b662-427e-989d-d1dca6c9d535 req-3be05720-94aa-412a-949c-270d6a13ab6f service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:01:33 user nova-compute[74421]: DEBUG nova.compute.manager [req-e10b12d1-b662-427e-989d-d1dca6c9d535 req-3be05720-94aa-412a-949c-270d6a13ab6f service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] No waiting events found dispatching network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 16:01:33 user nova-compute[74421]: WARNING nova.compute.manager [req-e10b12d1-b662-427e-989d-d1dca6c9d535 req-3be05720-94aa-412a-949c-270d6a13ab6f service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received unexpected event network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 for instance with vm_state active and task_state None.
Oct 23 16:01:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:01:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:01:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:03 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:08 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:02:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:02:08 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:02:08 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:02:08 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:02:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:02:09 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=24.941974639892578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:02:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:02:10 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:02:11 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:02:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:02:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:02:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:16 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:25 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:25 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:02:27 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:02:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:02:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:02:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:02:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:02:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:02:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:02:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:02:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:02:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:02:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:02:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:03:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:10 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:03:10 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=24.941421508789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 16:03:10 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 16:03:11 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:03:11 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:03:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:03:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:03:16 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 16:03:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-changed-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG nova.compute.manager [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Refreshing instance network info cache due to event network-changed-9c07e2aa-f747-4b58-b113-2a7f6efa7f19. {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG nova.network.neutron [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Refreshing network info cache for port 9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG nova.network.neutron [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated VIF entry in instance network info cache for port 9c07e2aa-f747-4b58-b113-2a7f6efa7f19. {{(pid=74421) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG nova.network.neutron [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:03:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-45bf6689-60b1-437c-b42b-965d38000d8f req-f70034ed-a9ea-4911-8813-3f04fbeeaf53 service nova] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:03:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 16:03:19 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 16:03:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:03:20 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:21 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:23 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:03:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:03:24 user nova-compute[74421]: DEBUG nova.objects.instance [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:03:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:24 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:03:25 user nova-compute[74421]: INFO nova.compute.manager [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attaching volume a043ea38-1497-42d0-913c-eb49cb543f51 to /dev/vdb
Oct 23 16:03:25 user nova-compute[74421]: DEBUG os_brick.utils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77645919-a054-477b-b93c-6a523ca1df91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c2b3c4-4ec9-493e-92ee-25b7c1d8dea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd7cbf-c620-46b6-a2fc-793eadea035e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5828a6e-f3da-4b6a-b6fc-36aeb88bca0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:03:25 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[db402ee2-5820-468e-978c-9d8938ab9cd6]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG os_brick.utils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating existing volume attachment record: 8190bcc1-d45b-4756-86bb-099e11c4c836 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:25 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:03:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:26 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:03:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:36 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWsAXMCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:03:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:03:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:03:41 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dc76d9-2d65-44c3-a2ec-ff2121ee9fd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 16:03:41 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf056b59-c799-4f2a-ac07-efcbdff77cfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51] added
Oct 23 16:03:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e7f01f-34b6-46b1-aba9-a20e0c21b8a1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d2cd73-b0fb-4a2b-98fe-c9d6da6be0ad]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWsAXMCD {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWsAXMCD" returned: 0 in 0.068s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2a0425-276c-447d-aae4-5fc1d7f20c98]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWsAXMCD'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc45e0-450d-4a6a-993b-003eb7c9cca0]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740f97c-3404-4d7d-b1f0-be4c08c1d6e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:03:41 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:03:41 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:03:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 16:03:41 user nova-compute[74421]: 
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c103ea3d-6c3a-494a-a2c2-b9cdf2504c59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260]
Oct 23 16:03:41 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260] successful.
Oct 23 16:03:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[95303782-ddfc-4d2f-b912-d81486dabf09]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4ff08-0216-4667-9e7b-4d070aa4dfb9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 (non-flash)
Oct 23 16:03:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 (non-flash)
Oct 23 16:03:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8f9f3-adf7-4901-b24a-b5ea83a29506]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 16:03:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWsAXMCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 16:03:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:03:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23931633138636665', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:03:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931633138636665', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 16:03:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:03:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 16:03:42 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:03:42 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:03:42 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:03:42 user nova-compute[74421]:   <serial>a043ea38-1497-42d0-913c-eb49cb543f51</serial>
Oct 23 16:03:42 user nova-compute[74421]: </disk>
Oct 23 16:03:42 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 16:03:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:03:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:03:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No VIF found with MAC fa:16:3e:1a:bc:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 16:03:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-fa414f7e-9d08-4e84-846a-cd129de31aec tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.106s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:03:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:51 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:56 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:03:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:06 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:10 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:04:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:04:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:04:10 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:04:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74421) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 16:04:11 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:04:11 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=24.940032958984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:04:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:04:12 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:04:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:04:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:04:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:04:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:04:15 user nova-compute[74421]: INFO nova.compute.manager [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Detaching volume a043ea38-1497-42d0-913c-eb49cb543f51
Oct 23 16:04:15 user nova-compute[74421]: INFO nova.virt.block_device [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attempting to driver detach volume a043ea38-1497-42d0-913c-eb49cb543f51 from mountpoint /dev/vdb
Oct 23 16:04:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Attempting to detach device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:04:15 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:04:15 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:04:15 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:04:15 user nova-compute[74421]:   <serial>a043ea38-1497-42d0-913c-eb49cb543f51</serial>
Oct 23 16:04:15 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:04:15 user nova-compute[74421]: </disk>
Oct 23 16:04:15 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:04:15 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config.
Oct 23 16:04:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:04:15 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:04:15 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:04:15 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:04:15 user nova-compute[74421]:   <serial>a043ea38-1497-42d0-913c-eb49cb543f51</serial>
Oct 23 16:04:15 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:04:15 user nova-compute[74421]: </disk>
Oct 23 16:04:15 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:15 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 16:04:18 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:04:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:26 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:26 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:04:27 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:27 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:04:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:04:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:35 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 is timed out.
Oct 23 16:04:35 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config.
Oct 23 16:04:35 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWsAXMCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:04:35 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a8d753-bfcd-4f54-915a-654a34415d7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 16:04:35 user nova-compute[74421]: No targets found.
Oct 23 16:04:35 user nova-compute[74421]: iSNS:
Oct 23 16:04:35 user nova-compute[74421]: No targets found.
Oct 23 16:04:35 user nova-compute[74421]: STATIC:
Oct 23 16:04:35 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51
Oct 23 16:04:35 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 16:04:35 user nova-compute[74421]:                 Iface Name: default
Oct 23 16:04:35 user nova-compute[74421]: FIRMWARE:
Oct 23 16:04:35 user nova-compute[74421]: No targets found.
Oct 23 16:04:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 16:04:35 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 16:04:35 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc95ad-3ca2-4f9a-acb4-c156ab02590d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[068d525e-ef98-4f37-960d-13e52ae62304]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 (non-flash)
Oct 23 16:04:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 (non-flash)
Oct 23 16:04:35 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24782fda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd875f-778c-4d19-8e33-a1e320a4a125]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc2543-c31c-4fbd-8a02-1a3128877f74]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d11f56-9b01-4b09-8c19-19d3fe40ef52]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[25575793-8865-4901-9874-cf48f30d8d11]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 16:04:35 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0df6378-4960-42f5-957c-dc85fd19a771]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0220ea90-763e-4515-baae-6f8221003368]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260]
Oct 23 16:04:36 user nova-compute[74421]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51, portal: 172.16.0.220,3260] successful.
Oct 23 16:04:36 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043ea38-1497-42d0-913c-eb49cb543f51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5e08d-a6c8-4666-9acf-bbba19b44862]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== disconnect_volume: return (273ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG nova.objects.instance [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:04:36 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-a025590f-b6f3-4d26-bf5c-0063c2229c76 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:04:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:04:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:04:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:05:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG nova.objects.instance [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:05:10 user nova-compute[74421]: INFO nova.compute.manager [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attaching volume 89e45199-a987-44c5-8554-eeee02246d43 to /dev/vdb
Oct 23 16:05:10 user nova-compute[74421]: DEBUG os_brick.utils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[501872c6-bed7-4d33-b067-0f1eda7212d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372f295-4178-47cc-94eb-0baffac06e55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9967b4d8-3b82-459c-90ff-a52783ca3032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6d0e5f-9a3d-45cd-bcd9-85f491d37005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:05:10 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 16:05:10 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb0f9c9-b2df-4e88-9305-aac241c8005d]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG os_brick.utils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:05:10 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating existing volume attachment record: d61707d4-3c39-46c7-8037-d025090ce6cd {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:05:11 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:05:12 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.931411743164062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:05:12 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:05:14 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:15 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:05:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:05:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:05:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:05:19 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:23 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:24 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHghRXPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:05:26 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:05:26 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:05:26 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79095e7-457d-4467-843e-5a10b2db3203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 16:05:26 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4abe3-16b5-4299-b147-415d062c98dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43] added
Oct 23 16:05:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824523d-6be0-4fff-8390-c5d455e998d4]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c798f9-112e-4d11-9a3e-5bf463daa875]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHghRXPe {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHghRXPe" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f44a33-e20b-4d5d-8724-e402569cfa1a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YHghRXPe'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a95762-4fc1-481b-9344-aa55dd4b4c3c]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3c8a0-18f3-402e-965a-e6e9e8d14ce1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:05:26 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:05:26 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:05:26 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 16:05:26 user nova-compute[74421]: 
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[32975fb8-62bb-49cc-a969-e85f28398130]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260]
Oct 23 16:05:26 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260] successful.
Oct 23 16:05:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f30c153-23b7-48e7-9b8b-fe4aebee6dcd]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[151037db-22ab-44fe-9084-2a8648a2e17b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 (non-flash)
Oct 23 16:05:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 (non-flash)
Oct 23 16:05:26 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef97c0e-02dd-449d-8d7d-215b848b1633]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 16:05:26 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHghRXPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23130336638366333', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130336638366333', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.objects.instance [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 16:05:27 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:05:27 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:05:27 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:05:27 user nova-compute[74421]:   <serial>89e45199-a987-44c5-8554-eeee02246d43</serial>
Oct 23 16:05:27 user nova-compute[74421]: </disk>
Oct 23 16:05:27 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:05:27 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No VIF found with MAC fa:16:3e:1a:bc:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 16:05:28 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-32f50b9c-7443-4be0-9706-e95ac1754468 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.554s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:05:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:05:29 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:05:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:05:30 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:05:30 user nova-compute[74421]: INFO nova.compute.manager [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Detaching volume 89e45199-a987-44c5-8554-eeee02246d43
Oct 23 16:05:30 user nova-compute[74421]: INFO nova.virt.block_device [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attempting to driver detach volume 89e45199-a987-44c5-8554-eeee02246d43 from mountpoint /dev/vdb
Oct 23 16:05:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Attempting to detach device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 16:05:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:05:30 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:05:30 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:05:30 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:05:30 user nova-compute[74421]:   <serial>89e45199-a987-44c5-8554-eeee02246d43</serial>
Oct 23 16:05:30 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:05:30 user nova-compute[74421]: </disk>
Oct 23 16:05:30 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:05:30 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config.
Oct 23 16:05:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 16:05:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:05:30 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:05:30 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:05:30 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:05:30 user nova-compute[74421]:   <serial>89e45199-a987-44c5-8554-eeee02246d43</serial>
Oct 23 16:05:30 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:05:30 user nova-compute[74421]: </disk>
Oct 23 16:05:30 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:05:30 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 16:05:31 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:34 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:39 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:05:44 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:05:49 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:50 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 is timed out.
Oct 23 16:05:50 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config.
Oct 23 16:05:50 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHghRXPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:05:50 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bb14b0-9e33-4885-a554-523e7812d42a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 16:05:50 user nova-compute[74421]: No targets found.
Oct 23 16:05:50 user nova-compute[74421]: iSNS:
Oct 23 16:05:50 user nova-compute[74421]: No targets found.
Oct 23 16:05:50 user nova-compute[74421]: STATIC:
Oct 23 16:05:50 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43
Oct 23 16:05:50 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 16:05:50 user nova-compute[74421]:                 Iface Name: default
Oct 23 16:05:50 user nova-compute[74421]: FIRMWARE:
Oct 23 16:05:50 user nova-compute[74421]: No targets found.
Oct 23 16:05:50 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 16:05:50 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 16:05:50 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8577e-8c37-4362-a509-63fb41b4b537]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b4cad3-fe02-4eed-abf0-c10d648ca0c9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 (non-flash)
Oct 23 16:05:50 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 (non-flash)
Oct 23 16:05:50 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f247839e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0736b573-4976-4c78-a68c-22a3730bfc55]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7a6d9-2ee0-4c8e-b950-1f2474a9b4e8]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26458d-645d-4815-8bb6-31e982c3929d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[44247607-1d36-413f-ad33-35e01b15b64f]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2eb4c-8564-4ac3-986d-a178223b3de3]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:50 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[12654dff-76d3-4dc7-9753-25d997bbe59d]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260]
Oct 23 16:05:51 user nova-compute[74421]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43, portal: 172.16.0.220,3260] successful.
Oct 23 16:05:51 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89e45199-a987-44c5-8554-eeee02246d43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c30017-8566-4821-838f-f86201972f60]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== disconnect_volume: return (257ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG nova.objects.instance [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:05:51 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-23544f32-603e-4540-a3b2-28032cc1ee4d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:05:54 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:05:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:05:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:05:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:05:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:05:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:09 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:06:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:15 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:06:15 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=24.930503845214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:06:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:06:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:19 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:06:20 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:24 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG nova.objects.instance [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:06:25 user nova-compute[74421]: INFO nova.compute.manager [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attaching volume 1a1f69f2-905a-40bd-ac2d-19a67f430cbd to /dev/vdb
Oct 23 16:06:25 user nova-compute[74421]: DEBUG os_brick.utils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce4b190-1cf6-4de8-963f-cfcfa9d3fa9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[82537613-dba8-40ac-b218-f3d98a663c03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[79301010-b691-43f0-8cda-198d420d47a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[71425866-18e5-4470-a859-9855c22b61e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:06:25 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 16:06:25 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95ce7a-1526-4515-9918-6c4090adacf4]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG os_brick.utils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:06:25 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating existing volume attachment record: 875625c4-a501-4151-8cea-36eb498d4a13 {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 16:06:26 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:28 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:28 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:06:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:32 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:06:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWpBIvGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:06:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:06:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:06:41 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da573f7-c53e-4aad-aa5b-266ff934dc93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 16:06:41 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[56660077-bb3d-4873-96f3-9d89371d35f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd] added
Oct 23 16:06:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7707ffa0-003c-4c93-bf81-1246169c735d]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ac949-9f96-4212-82ae-6ba1d821601e]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWpBIvGc {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWpBIvGc" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0e5c46-1133-41db-b3ba-d534a6aecbe5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWpBIvGc'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ab867-d2a7-41c0-94f1-be33905b95d5]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d377f00-4446-4dd0-a7c6-a305947ac879]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:06:41 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:06:41 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:06:41 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 16:06:41 user nova-compute[74421]: 
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af25c0d7-71b4-422d-aeb3-31c0c789de0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260]
Oct 23 16:06:41 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260] successful.
Oct 23 16:06:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e50c5-0ac5-4611-a2d9-2b43e612ee78]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f0385-1b74-4f3d-8e6a-f361e2f04be6]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd (non-flash)
Oct 23 16:06:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd (non-flash)
Oct 23 16:06:41 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d2090c-1135-4178-9b7c-fc5f1d34659b]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:06:41 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWpBIvGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23561656261643064', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561656261643064', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG nova.objects.instance [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:06:42 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 16:06:42 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:06:42 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:06:42 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:06:42 user nova-compute[74421]:   <serial>1a1f69f2-905a-40bd-ac2d-19a67f430cbd</serial>
Oct 23 16:06:42 user nova-compute[74421]: </disk>
Oct 23 16:06:42 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 16:06:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:06:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:06:43 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No VIF found with MAC fa:16:3e:1a:bc:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 16:06:43 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-287ef9cf-6479-49f3-ac73-a9119a567a18 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.751s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:06:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:06:45 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:06:45 user nova-compute[74421]: INFO nova.compute.manager [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Detaching volume 1a1f69f2-905a-40bd-ac2d-19a67f430cbd
Oct 23 16:06:45 user nova-compute[74421]: INFO nova.virt.block_device [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attempting to driver detach volume 1a1f69f2-905a-40bd-ac2d-19a67f430cbd from mountpoint /dev/vdb
Oct 23 16:06:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Attempting to detach device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 16:06:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:06:45 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:06:45 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:06:45 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:06:45 user nova-compute[74421]:   <serial>1a1f69f2-905a-40bd-ac2d-19a67f430cbd</serial>
Oct 23 16:06:45 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:06:45 user nova-compute[74421]: </disk>
Oct 23 16:06:45 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:06:45 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config.
Oct 23 16:06:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 16:06:45 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:06:45 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:06:45 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:06:45 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:06:45 user nova-compute[74421]:   <serial>1a1f69f2-905a-40bd-ac2d-19a67f430cbd</serial>
Oct 23 16:06:45 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:06:45 user nova-compute[74421]: </disk>
Oct 23 16:06:45 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:06:46 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 16:06:46 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:06:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:07:06 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 is timed out.
Oct 23 16:07:06 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config.
Oct 23 16:07:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWpBIvGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:07:06 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac78798-fd02-4f14-95c7-e16b6dcf3dae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 16:07:06 user nova-compute[74421]: No targets found.
Oct 23 16:07:06 user nova-compute[74421]: iSNS:
Oct 23 16:07:06 user nova-compute[74421]: No targets found.
Oct 23 16:07:06 user nova-compute[74421]: STATIC:
Oct 23 16:07:06 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd
Oct 23 16:07:06 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 16:07:06 user nova-compute[74421]:                 Iface Name: default
Oct 23 16:07:06 user nova-compute[74421]: FIRMWARE:
Oct 23 16:07:06 user nova-compute[74421]: No targets found.
Oct 23 16:07:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 16:07:06 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 16:07:06 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e330ff-f2ef-4692-8205-eadbaff81897]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2bac0-bbbf-4101-a9b1-32ecab1e2b60]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd (non-flash)
Oct 23 16:07:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd (non-flash)
Oct 23 16:07:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24781b9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2050e20c-6dc6-4b92-a9a8-cd1bfe261e5e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b735d9-f4cc-4789-b2d9-faf147b5de4b]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7223a0e-22bf-4475-aba6-2271239c1ce1]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489e1e4-6479-41d1-8b2a-21513aec70f1]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2441c09-80a8-4564-b195-e8dfddb0a1dc]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[46009415-56eb-4d06-8c12-65c6e4d58db8]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260]
Oct 23 16:07:06 user nova-compute[74421]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd, portal: 172.16.0.220,3260] successful.
Oct 23 16:07:06 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1f69f2-905a-40bd-ac2d-19a67f430cbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[762872d6-c575-4c08-9e18-9b7e0ac4f283]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== disconnect_volume: return (280ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:07:06 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 16:07:07 user nova-compute[74421]: DEBUG nova.objects.instance [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:07:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-0014c03f-f525-46b0-9c31-1409db4e4c4f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:07:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:07:13 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:15 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:07:15 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.929481506347656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:07:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:07:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:07:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:07:25 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:30 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:07:30 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:07:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:07:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:07:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:07:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:07:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:07:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:07:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:07:40 user nova-compute[74421]: DEBUG nova.objects.instance [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:07:40 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:07:41 user nova-compute[74421]: INFO nova.compute.manager [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attaching volume 4ca62c59-cd4e-453e-a9b0-f30bd118957f to /dev/vdb
Oct 23 16:07:41 user nova-compute[74421]: DEBUG os_brick.utils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5749bc58-880b-4aad-9980-e38d45377bb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:83b510926947\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68024e2-ac51-462e-b506-a4537866a922]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d616fa-732f-44c8-939b-5623186e85e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ad96d-f478-4ea8-807f-6f0a495efb78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Running cmd (subprocess): nvme version {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] 'nvme version' failed. Not Retrying. {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.nvmeof [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] nvme not present on system {{(pid=74421) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 16:07:41 user nova-compute[74421]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 16:07:41 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09a9fe-695f-4d77-abd4-34df6a9da7b5]: (4, '') {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74421) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.lightos [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] LIGHTOS: no hostnqn found. {{(pid=74421) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG os_brick.utils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:83b510926947', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:07:41 user nova-compute[74421]: DEBUG nova.virt.block_device [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating existing volume attachment record: 42fdcaab-384d-463c-bf92-bf59cf747a3a {{(pid=74421) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 16:07:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:07:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:07:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:07:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:07:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Calling os-brick to attach iSCSI Volume {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKGcmHZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:07:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:07:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:07:57 user nova-compute[74421]: INFO os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[add7adb6-9ca5-4286-a24e-87803146c7f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 16:07:57 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --interface default --op new {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2806b7-bdf5-4c25-9230-f2bd3668808c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f] added\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f] added
Oct 23 16:07:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3272aa4-122a-4295-9796-31c285b5a675]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f326d1-754b-48f7-a67e-f9173c80fc21]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKGcmHZg {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKGcmHZg" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c9d1d-def1-44ed-a6e1-573650aa4804]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sKGcmHZg'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8438a8a-a6a3-4cd0-8bf8-79662b69499a]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945c4c0-abb5-4ff6-abce-e96d93f862d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:07:57 user nova-compute[74421]:  {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 16:07:57 user nova-compute[74421]:  {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:07:57 user nova-compute[74421]: WARNING os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 16:07:57 user nova-compute[74421]: 
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --login {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb9edc-69cd-44ba-880e-8a4715569cb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260]
Oct 23 16:07:57 user nova-compute[74421]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260] successful.
Oct 23 16:07:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898f01c-2a35-4d96-90f2-5053fa3cd67b]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52a86bc-203e-4955-a2cb-dc935e132447]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f (non-flash)
Oct 23 16:07:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f (non-flash)
Oct 23 16:07:57 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to 172.16.0.220:3260 {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74421) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74421) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3544f1ea-d534-4aff-bde3-8aafd52ac353]: (4, ('- - 0', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:07:57 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74421) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKGcmHZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74421) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26462313334336330', 'path': '/dev/sdb'} {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462313334336330', 'path': '/dev/sdb'} {{(pid=74421) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG nova.objects.instance [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 16:07:58 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:07:58 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:07:58 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:07:58 user nova-compute[74421]:   <serial>4ca62c59-cd4e-453e-a9b0-f30bd118957f</serial>
Oct 23 16:07:58 user nova-compute[74421]: </disk>
Oct 23 16:07:58 user nova-compute[74421]:  {{(pid=74421) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vda, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74421) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] No VIF found with MAC fa:16:3e:1a:bc:32, not building metadata {{(pid=74421) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 16:07:58 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-355fc75e-b3b7-4d09-a9b0-123d0e46724f tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.830s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:08:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:08:00 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:08:00 user nova-compute[74421]: INFO nova.compute.manager [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Detaching volume 4ca62c59-cd4e-453e-a9b0-f30bd118957f
Oct 23 16:08:00 user nova-compute[74421]: INFO nova.virt.block_device [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Attempting to driver detach volume 4ca62c59-cd4e-453e-a9b0-f30bd118957f from mountpoint /dev/vdb
Oct 23 16:08:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Attempting to detach device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config. {{(pid=74421) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 16:08:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:08:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:08:00 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:08:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:08:00 user nova-compute[74421]:   <serial>4ca62c59-cd4e-453e-a9b0-f30bd118957f</serial>
Oct 23 16:08:00 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:08:00 user nova-compute[74421]: </disk>
Oct 23 16:08:00 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:08:00 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the persistent domain config.
Oct 23 16:08:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config. {{(pid=74421) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 16:08:00 user nova-compute[74421]: DEBUG nova.virt.libvirt.guest [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 16:08:00 user nova-compute[74421]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 16:08:00 user nova-compute[74421]:   <source dev="/dev/sdb"/>
Oct 23 16:08:00 user nova-compute[74421]:   <target dev="vdb" bus="virtio"/>
Oct 23 16:08:00 user nova-compute[74421]:   <serial>4ca62c59-cd4e-453e-a9b0-f30bd118957f</serial>
Oct 23 16:08:00 user nova-compute[74421]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 16:08:00 user nova-compute[74421]: </disk>
Oct 23 16:08:00 user nova-compute[74421]:  {{(pid=74421) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 16:08:01 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:01 user nova-compute[74421]: DEBUG nova.virt.libvirt.driver [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 16:08:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:08:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:08:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:08:13 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:08:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:08:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.928482055664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing inventories for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating ProviderTree inventory for provider a41abbd0-486b-47b6-812b-369e07ceaa0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Updating inventory in ProviderTree for provider a41abbd0-486b-47b6-812b-369e07ceaa0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing aggregate associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, aggregates: None {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Refreshing trait associations for resource provider a41abbd0-486b-47b6-812b-369e07ceaa0f, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74421) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:08:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:08:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:08:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:08:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:08:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:08:21 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4703e926-b710-49c2-9fab-3d72cf4af402 is timed out.
Oct 23 16:08:21 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully detached device vdb from instance 4703e926-b710-49c2-9fab-3d72cf4af402 from the live domain config.
Oct 23 16:08:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] calling os-brick to detach iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f248020f700>, {'target_iqn': 'iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKGcmHZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 16:08:21 user nova-compute[74421]: WARNING os_brick.initiator.connectors.base [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04cf09c-3000-4434-b2e9-e2bc1ae161a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 16:08:21 user nova-compute[74421]: No targets found.
Oct 23 16:08:21 user nova-compute[74421]: iSNS:
Oct 23 16:08:21 user nova-compute[74421]: No targets found.
Oct 23 16:08:21 user nova-compute[74421]: STATIC:
Oct 23 16:08:21 user nova-compute[74421]: Target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f
Oct 23 16:08:21 user nova-compute[74421]:         Portal: 172.16.0.220:3260,-1
Oct 23 16:08:21 user nova-compute[74421]:                 Iface Name: default
Oct 23 16:08:21 user nova-compute[74421]: FIRMWARE:
Oct 23 16:08:21 user nova-compute[74421]: No targets found.
Oct 23 16:08:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 16:08:21 user nova-compute[74421]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 16:08:21 user nova-compute[74421]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74421) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f', 0)] {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[225347cd-6beb-41c4-be87-87e9febaa7fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272b36a-8512-4cc7-a65a-ea5679bd9664]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f (non-flash)\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f (non-flash)
Oct 23 16:08:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f (non-flash)
Oct 23 16:08:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24780fcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f'): ({'sdb'}, set())}) {{(pid=74421) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Removing single pathed devices sdb {{(pid=74421) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d159071-d716-4c85-a86b-f6aa56b0ec66]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb846014-fa72-4fb7-a170-cd442d60a0e1]: (4, ('ok\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Flushing IO for device /dev/sdb {{(pid=74421) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c9b0ae-daaf-43b3-8e8d-bac89ff82113]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74421) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fed960-0b3f-44ac-babf-af18d06b2f43]: (4, ('1', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] SCSI volumes sdb have been removed. {{(pid=74421) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f')] {{(pid=74421) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d74e8f-bd4f-4dde-b8e2-55f1941deb79]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --logout {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[351631d2-9a82-47a0-8348-129c14791b33]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260]
Oct 23 16:08:21 user nova-compute[74421]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f, portal: 172.16.0.220,3260] successful.
Oct 23 16:08:21 user nova-compute[74421]:  stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op delete {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca62c59-cd4e-453e-a9b0-f30bd118957f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac2c1e-867b-42d2-a6b6-f7b4ea1e5eab]: (4, ('', '')) {{(pid=85617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74421) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.base [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] <== disconnect_volume: return (262ms) None {{(pid=74421) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Disconnected iSCSI Volume {{(pid=74421) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 16:08:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:22 user nova-compute[74421]: DEBUG nova.objects.instance [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'flavor' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:08:22 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-3c8a6048-9fe3-4bbb-b3b8-cb526a1e0936 tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.623s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:08:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:24 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:08:27 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:29 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74421) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 16:08:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:31 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:08:32 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:32 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Cleaning up deleted instances {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 16:08:32 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] There are 0 instances to clean {{(pid=74421) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 16:08:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:08:37 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:08:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:08:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:09:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:09:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:09:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:09:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:09:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:09:13 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:09:13 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG oslo_concurrency.processutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 16:09:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:09:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=24.927719116210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Instance 4703e926-b710-49c2-9fab-3d72cf4af402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74421) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:09:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquired lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Forcefully refreshing network info cache for instance {{(pid=74421) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 16:09:15 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lazy-loading 'info_cache' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:09:16 user nova-compute[74421]: DEBUG nova.network.neutron [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [{"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:09:16 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Releasing lock "refresh_cache-4703e926-b710-49c2-9fab-3d72cf4af402" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 16:09:16 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updated the network info_cache for instance {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 16:09:18 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:18 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Triggering sync for uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 16:09:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:09:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:09:18 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:09:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:09:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:23 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:29 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:32 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:32 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:09:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:09:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:09:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:09:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:04 user nova-compute[74421]: INFO nova.compute.manager [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Terminating instance
Oct 23 16:10:04 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Start destroying the instance on the hypervisor. {{(pid=74421) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:04 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-014d5570-3087-4249-8be9-bd848b57ad94 req-0682b349-dc81-408e-88e9-6315542db2b4 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-vif-unplugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-014d5570-3087-4249-8be9-bd848b57ad94 req-0682b349-dc81-408e-88e9-6315542db2b4 service nova] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-014d5570-3087-4249-8be9-bd848b57ad94 req-0682b349-dc81-408e-88e9-6315542db2b4 service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-014d5570-3087-4249-8be9-bd848b57ad94 req-0682b349-dc81-408e-88e9-6315542db2b4 service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-014d5570-3087-4249-8be9-bd848b57ad94 req-0682b349-dc81-408e-88e9-6315542db2b4 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] No waiting events found dispatching network-vif-unplugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.compute.manager [req-014d5570-3087-4249-8be9-bd848b57ad94 req-0682b349-dc81-408e-88e9-6315542db2b4 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-vif-unplugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 for instance with task_state deleting. {{(pid=74421) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [-] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Instance destroyed successfully.
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.objects.instance [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lazy-loading 'resources' on Instance uuid 4703e926-b710-49c2-9fab-3d72cf4af402 {{(pid=74421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.virt.libvirt.vif [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T16:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-291319157',display_name='tempest-SnapshotDataIntegrityTests-server-291319157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-291319157',id=50,image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYV3WVxhSEgGKF17DKEapDBQEYdveMe1Jztl9HSUuvPzlk2IqLtBAbncEf0piAff/bD8BRatkal/EyFnYSo4bExg4XZUYiPdMnLSLiyFzMzXdcaifuzdTxHPg+49tRPVw==',key_name='tempest-keypair-91072463',keypairs=<?>,launch_index=0,launched_at=2023-10-23T16:01:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='214fcda267154c66876db5ad7a4b540c',ramdisk_id='',reservation_id='r-pha1mk16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8df87536-9d51-4582-bc16-f205abcf2ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1759465241',owner_user_name='tempest-SnapshotDataIntegrityTests-1759465241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f03fb67d444547f0a4690111647a9834',uuid=4703e926-b710-49c2-9fab-3d72cf4af402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Converting VIF {"id": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "address": "fa:16:3e:1a:bc:32", "network": {"id": "30b0c35c-21d3-4d90-ad37-69591f25a573", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-881485752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214fcda267154c66876db5ad7a4b540c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c07e2aa-f7", "ovs_interfaceid": "9c07e2aa-f747-4b58-b113-2a7f6efa7f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.network.os_vif_util [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7') {{(pid=74421) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG os_vif [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7') {{(pid=74421) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c07e2aa-f7, bridge=br-int, if_exists=True) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0649bd39-2b5a-4bc4-b27d-25dc46d715f1) {{(pid=74421) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:05 user nova-compute[74421]: INFO os_vif [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=9c07e2aa-f747-4b58-b113-2a7f6efa7f19,network=Network(30b0c35c-21d3-4d90-ad37-69591f25a573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c07e2aa-f7')
Oct 23 16:10:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Deleting instance files /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402_del
Oct 23 16:10:05 user nova-compute[74421]: INFO nova.virt.libvirt.driver [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Deletion of /opt/stack/data/nova/instances/4703e926-b710-49c2-9fab-3d72cf4af402_del complete
Oct 23 16:10:05 user nova-compute[74421]: INFO nova.compute.manager [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 23 16:10:05 user nova-compute[74421]: DEBUG oslo.service.loopingcall [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74421) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.compute.manager [-] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Deallocating network for instance {{(pid=74421) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 16:10:05 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] deallocate_for_instance() {{(pid=74421) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 16:10:06 user nova-compute[74421]: DEBUG nova.network.neutron [-] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Updating instance_info_cache with network_info: [] {{(pid=74421) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 16:10:06 user nova-compute[74421]: INFO nova.compute.manager [-] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Took 0.86 seconds to deallocate network for instance.
Oct 23 16:10:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:06 user nova-compute[74421]: DEBUG nova.compute.manager [req-7811442e-641d-459d-af23-52000ba3449e req-b4fa5c17-6ad1-434b-94ef-6b4f03d6b364 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-vif-deleted-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:10:06 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:10:06 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:10:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:06 user nova-compute[74421]: INFO nova.scheduler.client.report [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Deleted allocations for instance 4703e926-b710-49c2-9fab-3d72cf4af402
Oct 23 16:10:06 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9e7477cc-9ef4-4147-a99d-c4b12188495d tempest-SnapshotDataIntegrityTests-1759465241 tempest-SnapshotDataIntegrityTests-1759465241-project-member] Lock "4703e926-b710-49c2-9fab-3d72cf4af402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-15e8a23d-cc7f-48d3-be51-e7d41ad48a5b req-c00b6aa4-8179-4ad2-99e0-735929cc1256 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received event network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 16:10:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-15e8a23d-cc7f-48d3-be51-e7d41ad48a5b req-c00b6aa4-8179-4ad2-99e0-735929cc1256 service nova] Acquiring lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-15e8a23d-cc7f-48d3-be51-e7d41ad48a5b req-c00b6aa4-8179-4ad2-99e0-735929cc1256 service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:07 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [req-15e8a23d-cc7f-48d3-be51-e7d41ad48a5b req-c00b6aa4-8179-4ad2-99e0-735929cc1256 service nova] Lock "4703e926-b710-49c2-9fab-3d72cf4af402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:07 user nova-compute[74421]: DEBUG nova.compute.manager [req-15e8a23d-cc7f-48d3-be51-e7d41ad48a5b req-c00b6aa4-8179-4ad2-99e0-735929cc1256 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] No waiting events found dispatching network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 {{(pid=74421) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 16:10:07 user nova-compute[74421]: WARNING nova.compute.manager [req-15e8a23d-cc7f-48d3-be51-e7d41ad48a5b req-c00b6aa4-8179-4ad2-99e0-735929cc1256 service nova] [instance: 4703e926-b710-49c2-9fab-3d72cf4af402] Received unexpected event network-vif-plugged-9c07e2aa-f747-4b58-b113-2a7f6efa7f19 for instance with vm_state deleted and task_state None.
Oct 23 16:10:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:13 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:10:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:10:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:10:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9159MB free_disk=24.95482635498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:10:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:10:15 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:10:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:10:15 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 16:10:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:22 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:23 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:25 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:25 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:30 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:31 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:33 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:33 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74421) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 16:10:35 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:35 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:38 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:10:40 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:45 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:10:50 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:55 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:10:59 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:00 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:02 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:05 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:10 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:13 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:11:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:11:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:11:13 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:11:13 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74421) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 16:11:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:11:14 user nova-compute[74421]: WARNING nova.virt.libvirt.driver [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 16:11:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Hypervisor/Node resource view: name=user free_ram=9294MB free_disk=24.951885223388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74421) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74421) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG nova.compute.provider_tree [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed in ProviderTree for provider: a41abbd0-486b-47b6-812b-369e07ceaa0f {{(pid=74421) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG nova.scheduler.client.report [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Inventory has not changed for provider a41abbd0-486b-47b6-812b-369e07ceaa0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74421) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG nova.compute.resource_tracker [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Compute_service record updated for user:user {{(pid=74421) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 16:11:14 user nova-compute[74421]: DEBUG oslo_concurrency.lockutils [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 16:11:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:11:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 16:11:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74421) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 16:11:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:11:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:15 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74421) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 16:11:17 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:11:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Starting heal instance info cache {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 16:11:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Rebuilding the list of instances to heal {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 16:11:17 user nova-compute[74421]: DEBUG nova.compute.manager [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Didn't find any instances for network info cache update. {{(pid=74421) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 16:11:20 user nova-compute[74421]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74421) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 16:11:21 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:11:24 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 16:11:24 user nova-compute[74421]: DEBUG oslo_service.periodic_task [None req-9c47688d-4f93-413c-bc26-ffaec604aa46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}